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Objectives of the Course 



1 . Become acquainted with a representative sample of recent 
user-adaptive systems 

• These can serve as reference points for later thinking about such 
systems 



2. Learn about the main high-level decisions that need to be made 
when designing a user-adaptive system 

• For each such decision, get to know 

• the considerations to be taken into account 

• the major available alternatives and their strengths and 
limitations 



3. Gain active experience in applying these ideas to a specific design 
problem 



Abstract 



After defining the concept of a user-adaptive system, we will note the 
main usability issues that such systems raise and the reasons why they 
are gaining rapidly in importance. We will then consider, in turn, five 
high-level decisions that need to be made in the design of a system that 
adapts to its users: 

1 . What function is to be served by the adaptation? 

2. What properties of users should be modeled? 

3. What types of input data about the user should be processed? 

4. How should the system make the necessary inferences about the 
user? 

5. What empirical studies should be conducted to ensure or evaluate 
the success of the adaptation? 

For each decision, we will discuss and evaluate, with reference to 
recent examples, the main alternatives that should be considered. 
During the interleaved workshop sessions, participants will make use of 
the ideas presented by working on the high-level design of a 
user-adaptive conference web site for CHI 2002. 
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Introduction I Concep ts 

Introduction 
^nP^iAdaptlv^ Advisor 0) 




S;s e Route Advis ^H^^^« 



Example^Adaptive Route Advisor 



(2) 




MACHINE LEARNING 



SEARCH ALGORITHM USING 
IMPORTANCE WEIGHTS 
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Adaptivity Within HCI 
jsWhere Are User-Adaptive Systems Found? < 1 ) 

In the HCI literature 



o 

T3 
C 



I • A small proportion of the systems studied in HCI are user-adaptive 
• About 2 full papers at each CHI conference* 



c 

| In the literature of more specialized fields 

o 

03 
> 

% • Adaptive / intelligent user interfaces 

<D 
Q. 

| • Intelligent (information) agents 

o 
o 

CM 

5 • User /student modeling 



Where Are User-Adaptive Systems Found? < 2 ) 

Examples of systems in actual use 

• Personalized web sites 

• Amazon: http://www.amazon.com 

• MyYahoo! http://www.yahoo.com 

(More adaptability than adaptation) 

• Other commercially available systems 

• Office Assistant of Microsoft 

| Best known, largely for features unrelated to adaptivity 

| • Adaptive News Server of Adaptivelnfo (see 
| http://www.adaptiveinfo.com) 

I Young firm specializing in personalization for wireless devices 

O) 

5 • Systems being used but not sold commercially 

| (See discussions below:) 

| • Publication Recommendation Agent 

i • ELM-ART learning environment 
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Central Usability Issue 



Widespread concern 

• Adaptation can reduce the controllability and predictability of a 
system for its users 
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| w Treatment of this problem here 
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|g • With different types of system, different degrees and forms of this 
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problem 

Next subsection: Framework for analyzing it in specific cases 



Three Levels of Controllability 
Level 2: Skill w 

Situation 

• Zl is highly skilled in using a particular aspect 5* of a system 

• Automatic processing, with little attention or conscious control 

(Typing, selecting frequently used menu items, ...) 

• Reliance on S* behaving consistently, predictably 

Consequences of adaptation 

• Automatic processing may be replaced by conscious, controlled 
processing 

• Even if U\s aware of the adaptation, processing may be disrupted 
and errors may be made 

Recommendation 

In general, avoid adaptation that could have these effects 
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Introduction I Three Levels of Controllability 
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19 Level 1: Familiarity 

Situation 

• Zl is familiar with S* (or with similar aspects of other systems) 

• Zl has expectations about 

• where things can be found 

• what the effects of her actions will be 

• Zl has some mental model of how S* works 
Consequences of adaptation 

• Zl can to some extent cope with changes in S"s behavior 

• Zl may require more time and more trial and error to operate J* 

• U may have more difficulty interpreting 5*'s behavior 
General recommendation 

• Consider the seriousness of these costs of adaptation 

• Try to reduce costs by 

• keeping adaptations moderate and infrequent 

• announcing them and obtaining Zts approval 

• allowing them to be undone 



Level 0: Lack of Knowledge and Contr ol 2 
Situation 

• Zl wants to get a particular type of result from 5* 

• Zl has at best vague expectations as to how $ will behave or how 
S* works 

• Zl has little time or desire to understand 5* better 

• Zl will just judge if the results produced are acceptable 

Consequences of adaptation 

• Adaptation may concern aspects of S* that are not noticed by Zl 
anyway 

• Adaptation may produce more useful results for Zl 

Recommendation 

• Even drastic adaptation may be OK as long as these conditions hold 

• Allow for a shift to adaptability if Zl might move to Level 1 or 2 
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Increasing Importance 
21 Why Are These Systems Important Now? < 1 > 

Decline in opportunities for controllability 

• Users are finding it harder to achieve controllability on Levels 1 and 
2 with all of the systems they use: 

• Systems are becoming more numerous 

Especially on the web, where each web site may be a new 
"system" - or a conglomerate of several new systems 

• Systems are becoming more complex 

With each new version, more functionality, more features ... 

• So interaction on Level 0 is increasingly frequent and important 

• The benefits of adaptivity tend to be greatest here 
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Why Are These Systems Important Now? < 2 ) 22 

J Increasing diversity of users and contexts of use* 

• It is getting harder to design a system that is 

• highly usable for all types of users and contexts, or even 



I • readily adaptable by users to their own properties and use 
< i contexts 
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gl Increasing feasibility of successful adaptation 
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5 IT • Advances in machine learning and automated reasoning 



Broader bandwidth of communication from user to computer (in 
some types of system) 
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P^§" • Greater technical support for flexibility in system behavior 
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Functions (1)1 Overview 



24 



Functions (1) 
23 Overview of Functions of Adaptation 

1. Help lito Find Information 4. Help With Routine Tasks 

2. Tailor Information to 11 5. Adapt an Interface 

3. Recommend Products 6. Give Help 

7. Support Learning 

8. Conduct a Dialog 

9. Support Collaboration 



Questions About Functions of Adaptation < 1 > 24 

Task 

• What task is 11 and/or S performing? 

Normal division of labor 

• In a nonadaptive system, which aspects of the task would be 
performed by 11 and by S? 

Division of labor with adaptation 

• How does adaptivity lead to a change in the division of labor - or in 
other aspects of the performance of the task? 

Relevant properties of Zl 

• What are the main properties of 11 that S takes into account when 
deciding how to adapt? 
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Functions (1) I Overview 



25 



Questions About Functions of Adaptation ( 2 ) 

Potential benefits 



• What are the main potential benefits of this type of adaptation? 



Limitations 

• What are the main difficulties or disadvantages? 

• In particular, to what extent is controllability an issue? 
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Help U to Find Information 
The Publication Recommendation Agent ( 1 > 
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The agent recommends specific publications of Michael J Pazzani to 
visitors to his web site 
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Functions (1) I Help U to Find Information 



27 The Publication Recommendation A gent < 2 ) 

Recommendation principles 



S has can suggest a publication 2>for several different reasons: 

1. dissimilar to the paper just downloaded 

2. IP cites the paper just downloaded 

3. 2>is cited by the paper just downloaded 

4. 3>is most frequently downloaded in combination with the last 
paper 11 downloaded 

5. 2>has been added to the web page since It's last visit and 11 has 
previously downloaded a paper that is cited by 2> 

6. fPis the most frequently downloaded paper that U hasn't 
considered 



The Publication Recommendation Age nt < 3 ) 

Adaptation 

• S learns the relative importance of these reasons for Zl by learning 
from Us acceptance and rejection of recommendations 

Adaptability 

• U can also explicitly specify: 

• Which of the above reasons should not be considered 

• Which topic areas (in terms of key words) are of interest 

Timing 

• The agent makes a recommendation in three situations: 
1 . 11 has clicked on the link "Suggest" 

.2. U has just downloaded a paper 

3. The system has been idle for a few minutes 
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Functions (1) I Help 11 to Find Information 
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Overview of Adaptation 




HEBBIAN LEARNING 




DOWNLOAD ACTIONS, 

RESPONSES TO 
RECOMMENDATIONS, . 




PROCEDURE FOR 
WEIGHTING COMPETING 
RECOMMENDATIONS 
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Evaluation 


30 


Impact of agent on paper downloads 




Period 


Mean number of 




downloads per visit 


60 days before introduction of agent 


2.41 


120 days after introduction of agent 


4.77 



c c 

O 01 



Interpretation 

9 Questions about the sharp increase: 



■Js 1. Might it be due to: 



• the agent's aggressiveness in making recommendations? 
if • users' enjoyment of interaction with the agent? 
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What can we infer about the specific appropriateness of Ss 
recommendations for 111 
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Functions (1) I Help U to Find Information 
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31 Discussion ( 1 > 

Task 

• Finding information relevant to U in a large collection of information 

Normal division of labor 

• Browsing: 

• U navigates within a hypertext system 

• Query-based information retrieval and filtering: 

• S retrieves items matching 1/s query 

• U looks for relevant items among those retrieved 

Division of labor with adaptation 

• Browsing: 

• Zl navigates, but S gives advice about where to look 

• Query-based information retrieval and filtering: 

• Ss choice and presentation of retrieved items take into account 
information about U that goes beyond Us query 

Discussion < 2 > 3 . 

Relevant properties of U 

• Us current information need, goals, and general interests 

Potential benefits 

• Browsing: 

• Better decisions by Zl about what links to pursue 

• Query-based information retrieval and filtering: 

• Higher recall and precision 

Limitations 

• For a skilled U, it may be harder to interpret absence of results 

• "Are there really no results concerning X, or does S just think I'm 
not interested in them?" 
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Functions (1) I Tailor Information to 11 
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Tailor Information to 11 
Medical Information: Nonpersonalized W 



Patient Information System 


Touch any highlighted phrase for more information 
ontiiat Jopic. 


Beatson Oncology Certee 


About Cancer 


Breast Cancer 


Cancer of 'he Cervix 


Cancer of the Larynx 


Prostate Cancer 


feelings and Emotions 


Complaints and Queries 



» S 
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Nonpersonalized introductory screen 

11, who is being treated for prostate cancer, clicks on that topic 



Medical Information: Nonpersonalized W 
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Prostate Cancer 



The information tias been divided into ? categories. 

Touch one of the highlighted words or phrases 
below for more information on a topic. 

about prostate cancer 

prostate cancer: risk factors 

symptoms 

diagnosing prostate cancer 
treatments 

self care during radiotherapy 
further sources of information 

m raa 



General overview screen on prostate cancer 

By continuing to browse, U will access further nonpersonalized pages 



35 



Functions (1) I Tailor Information to Zl 
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Medical Information: Personalized ( 1 ) 



The Re cord of DonaJd Domo 

The information in your record has been divided 
into the following 4 categories. Please touch one of 
the highlighted words to see your details. 

Personal Information 

Investigations 

Problems 

Treatments 

There is also general information on the following 
topics: 

About Career 

Eeatson Oncology Centre 



The personalized version begins with an index screen for the patient- 



medical record 
Zl clicks on "Problems" 



Medical Information: Personalized ( 2 ) 



Donald Smith: Prostate Cancer 



According to your record, you are being treated for 
this problem. 

Your prostate cancer is described in medical words 
as being a grade 2+3. localised, adenocarcinoma. 
The cancer was sited in the left loise of your 
prostate gland and had affected th.e capsule 
surrounding it. One cf your seminal vesicles may 
also be affected by the cancer. 

Your cancer was staged according to the TNM 
System as T3. 



Zl receives information about his specific medical problem 
By continuing to browse, Zl will access further personalized paqes as 
well as some nonpersonalized pages ' 



37 , Functions ( 1) I Tailor Information to Zl 38 

37 Overview of Adaptation 




Evaluation (Summary) 

Main results of study of actual use 

• Patients using personalized version ... 

• Found information much more relevant 

• Were somewhat more satisfied overall 

• Were a bit more inclined to use the system 

• (Detailed results in Section "User Studies") 
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Functions (1)1 Tailor Information to Zl 
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Discussion < 1 > 

Task 

• S presents information to Zl about some topic 
Normal division of labor 

• S (generates and) presents the same information in the same form 
to all users 

Division of labor with adaptation 

• S may generate a different presentation for each user in terms of 
content and/or form 

Relevant properties of Zl 

• Interests (sometimes inferred from personal characteristics) 

• Knowledge 

• Influences Us need to see particular information and her ability 
to understand it 

• Presentation preferences 

• For media, for concrete vs. abstract forms of presentation 



Discussion < 2 ) 

Potential benefits 

• Greater comprehensibility, relevance, and enjoyment for Zl 
Potential controllability problems 

• Different users receive different information, so they can't 
communicate as easily with each other 

• Changed presentations may be harder to interpret 

• Zl may have less control over form and content 

Avoiding controllability problems 

• Don't change too often: 

• the form of presentation 

• the general criteria underlying the selection of content 

• Announce such changes and have Zl approve them first 

• Give Zl option of exercising control over presentation 
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Recommend Products 
Explicit Approach: PersonaLogic 




Would you prefer a dog with more or less indoor 
energy? 

Oogt with mots indoor entrgy are conttanCy on tha raova, and have a hard Omt 
lining %W. Thay tniff. thay groora, thay play, and lhay lika to tpand most of thalr 
waking hour* being acOvi. Dogs wtm last Indoor energy prefer to tpend their 
time retting, and are typically content to steep the day away. 




How much Unto can you spend exercising the dog 
outdoors each day? 

In fairness to your new companion, try to De realistic when answering this 
question. Exercising your dog Is one of the best ways to keep it healthy, but If 
you barely have enough finta In the day for yourself, you probably thoutdnl 
expect to spend an hour jogging with your dog. 



How important to you is a dog that's easy to train? 

Some dogs are more stubborn than others. V you want a dog that will team and 
obey your commands, place more emphatls here. If you donl plan to teach your 
dog more than a few tricks, this worn matter much. 



jg Sites like PersonaLogic recommend "products" after querying U 
I explicitly about her evaluation criteria 

4 The approach is also applied to items like pets, mutual funds, and 
f presidential candidates 



MovieCentral 
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ITlDuieCenTRAL. 



sharperimage.com 

Great products! Shop on-line. 



■ i . -Jl, 3333 i n i jnj i w.u nn 



Step 2: Rate at least 10 movies - so far you've rated 7 

Click any tine for more Information. 




The Best Year s of Our Lives (1946) 

Starring: Mvrna Lov. Fredrtc March Dana Anrtrsw, 
Dtntcmr William «M»r 



StPlvfisI 

Your Rjthtg (CMcfc to CtUBft) 
[Mimtfi sS SfTTTI f rtet Imorttwd 1 



Paris. Texas (19841 

SUntng: H«tassj a fl/u la, Harry Dean Stanton. Dea n Stcrtwell 
Director: Wtm wend an 



IVUSl 



Yaur fUtbtp: Wry Good 



Usls 
My Riilmijs 
My Reviews 
My Friends 
My Catalog 
My Gil Reyislry 
My Remit. iter List 



Rate Mure Mimes 
View My P.Hje 
Moctity t.ly Paye 
See My ("units 




Life of Brian f 19791 

Starring: rennam Colin.- £ 
Director: Terrv Jon« 



Your Rjttag (CQck to Chatngtt) 



M 



The Bridoes nl Madison County H9951IPCT51 

Stantag: Mgrvl strf-eo 
anclnr; Clint Faimmu 



agiwsi 

Your tattoo, (Ctlcfc to Ounrjt) 



s Sites like MovieCentral require no representation of Z£s evaluation 
| criteria 

I After U has rated a certain number of films, S identifies other users with 
f similar tastes 
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MovieCentral ( 2 ) 



Movie Details ~ 

MOV A Space OdygypIiTa) Q 



Science Fiction hrs. 0 rnin ) 



Starring: Keir Dullsa 

William ,Svlv»<| p r 
Gary Lockwq r jrt 
Daniel Rirhlar 

so Leonard Rn«i| ?r 




^ I'BuylMor/aitotfi) 

Director: Stanley K„r,fW (' Borrow Movie ~) 

RaUng: El _ ' 

fr Already Own Hi 

(r GmReqbtry ) 

(f~ Reminder Uat ] 



Your Rating: Aw nfl* 



Predicted Rating: Vary Good 

" I I I I I I I.MB 

CdnfltJence: Very High 



Internet Movie Database: 2001: A Soace Odvsspy ■ 



Avrt ga Rating: Good 

I I I I I I I I MM 

Number of Ratings: 2213 

Click hsss. to write a review for 2001 : A Space Odyssey 
lenJuJai from BeiDngharn, WA wrote: 



■While watching the movie. I was certain that I was having a fevnr dream It wasnl 
neallh — ..." 503 " ' 

Having identified similar users, S can now 

• predict how Zl will rate a given film 

• present reviews from similar users 



my " 



Similarity: High 



MovieCentral W 



Best Bets: > 



Any Genre 



□DVD Only 



1. HSSsEffl Ran(1885)E 




Starring: Tatsuua Nakarlai Akira Teran Jlnpachi Nez u 
Director Akira Kurosawa 



OSSh Crouchinn Tiger. HMrlpn rVarp n (2000) lt*G-13l 

&0Sffi Starring: Chow Vun Fat Zhang Zi-Vi Michelle Vanh 
?J WM Director Ana Lee 




0abet££5_Feast (1 987) (BJ 

Starring: Pouel Karn t 
Director: Gabriel Axel 



. Bodil Kjer 



-.Jjif^J.^^^^.^^^^ ^ OSS 

Upon request, 5 presents a ranked list of recommended films "~ 
The top recommendation had a predicted rating for Zl of 10 
U now enters her actual rating of 3 ("bad") 



Your Rating : Bad 

I ;j 

I Havent Se^Trp I N 1t jmCTjjjaT) 



Your Predic tion (click to Rats) 
IHavemsmin Itl i M^ijn^^j 



fVHSl 

Your Prediction (click lo Ratal 
iHaviims«« q -|fll ^ipjjgjg-i 
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MovieCentral < 4 > 



Best Bets: 



Any Genre 



QDVD Only 




Crouching Tioer, Hidden Dragon (2000) IPG-131 



Starring: Chow \ 
Director: Anq Lee 



Your Rating 



I Havon't Seen It II Net Intereiled I 




t (1987) B 



."-fr^JOkl Starring: Pouel Kern. 1 
Director. Gabriel Axel 



aid, Bodil Kjer 



IVHSl 

Your Prediction (dick to Rate) 

i i i i i m una 

IHavuntSeenTTi I Not lnHreited I 




Jean De Florette ( 1 986) 

Starring: Yves Montand. Daniel Auteuil. Gerard Decardieu 
Director: Claude Berri 



Your Prediction (click to Rato) 

II II I I I II 1,151 

IHmMHSewnn I Not Interested 1 



The Wrong Trousers (1993) 



U has requested a new set of recommendations 
The film rated "bad" has disappeared 

Otherwise, no change is visible among the 11 recommendations 



MovieCentral < 5 ) 
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Today's Featured Movie: 

y< s. _ „ i •.- .r_* • ^ , . : « . 

Starring: Keir Dullea Director. Stanley Kubrick 

William Sylvester R^g. © 
Gary Loclcwood - 1 

Papiel RIcMer 
' Leonard Rossiter ■ 




Awriga Rating: Good 
Number of Ratings: 2214 



Your Rating: Avaraga 



69 SS 89 69 Q Q 



Best Bets In Theaters 
1. 




Crouching Tiger Hidden Dragon 
Starring: 
Chow Yun Fat 
Director. 
Ano Lee 
LTOJCHHCUB 
KDOWDUOM 

2. Unbreakable 

3. Remember the Titans 

4. Vou Can Count on Me 

5. The Legend of Baooer Vance 



Best Bets On Video 
1 ■**p™ MB Jean De Florette 
' P4lWc Starring: 

FLORfc TTl y ves Mon | anc | 

Director 

Claude Berri 




2. Tampopo 

3. Waiting For Guffinan 

4. Blue 

5 The Wrong Trousers 



On January 1st, 2001, this film remained "Today's Featured Movie" 
even after 11 had given it an indifferent rating 
More generally, product recommenders often leave some aspects of 
their pages insensitive to changes in the user profile 
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Overview of Adaptation 



CD 

c 




COMPUTATION OF 
"AGREEMENT STRENGTH" 
WITH OTHER USERS 



COMBINATION OF 
MENTORS' RATINGS 




US RATINGS OF MOVIES 





CO Co 
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c u -Eo 
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• 5 pr. 



Evaluation C) 
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Scientific research 

Many studies* have shown that social recommendation techniques 
such as those used at MovieCentral produce recommendations 
whose accuracy for an individual user is usefully high 

• See the discussion in the section on "Inference" 



^•{jis Use of commercial sites 

2 in <=I a. 

QJ CO ° 
X)5T3 CO fO 
CO fc T3 O) 

Q) - C (/) O 

.» c«.ag 

o,co £Z °- 

S|Is8 
5I3«| 
®w£§f 

3 q>E S 8 ■ 
.5 a> err co 



• Regarding commercial sites, fewer scientific evaluations are 
available 

• The claims on the following slide (paraphrased from a white paper 
on the LikeMinds personalization server) are typical 
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Evaluation < 2 ) 



CN SO 



Claims about effectiveness of Like Minds 



* g & Behavior of typical user of a LikeMinds server: 



lift • Rates 80 products 
Ills • Views 50 pages per visit 

.2 ^ O.N 

w ?s§| 

aj^ oj g g 



r «SSE 



• Receives 40 product recommendations per visit 

Survey responses of Movie Critic* users: 
§| • Reasons for using Movie Critic 



• Saved them time and money choosing movies 
| | " l ncrease d their confidence in selecting movies 
f I * Helped them see fewer duds 



Was "just plain fun" 



.2 E c » u 

"l.s £ I • Overall satisfaction 

111 II ' More than 90%: "love it" or "really good" 



Discussion < 1 ) 
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Task 

• Find objects suitable for use by 11 

Normal division of labor 

• S provides object descriptions 

• U searches through them, evaluating the objects 

Division of labor with adaptation 

• 11 provides some indication of evaluation criteria 

• 5 recommends suitable objects 

Relevant properties of U 

• Us evaluation criteria 
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« Discussion ( 2 ) 

Potential benefits 

• 11 saves time and effort searching 

• £i covers a larger number of potential objects 

Limitations 

• Us evaluation criteria may be hard to assess adequately in the 
limited time available 

• In commercial systems, issues of trust and responsibility are more 
complex when recommendations are made adaptively 
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Functions (2) 
SwiftFile Demo < 1 ) 




o» ffl r<D 3 



Active users of electronic mail may receive dozens or even hundreds of 
messages every day 

Message folders (left panel) allow users to organize their messages to 
ease later retrieval 



SwiftFile Demo < 2 ) 
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Messages are filed in Lotus Notes by pressing the MoveToFolder button 
and choosing the destination folder from a selection window 
Regardless of the exact interface, the cognitive effort required to decide 
upon an appropriate folder and locate the icon or menu item 
representing it is substantial enough that many users fall behind in filing 
their e-mail 
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SwiftFile Demo ( 3 ) 




Lii'6\Toit Lo lining 



Lo lining I'**— ■ '» ) 



VMm Hmth charf><koluw ,hJu> o* OF/1 V3S I Hi 54 PM 



Hit 



collections lor t«oit o*i»yarij*tic«, tptrt 
•tnav* quniM! or locd ii in a 



Vbtcb ata t he ct*nlt»<j mi 

" B«t««-m7« colUction 
- TSEC-iP collection 
~ 0SHUK9 collection' (ETD I 
browser)? 



SwiftFile uses a text classifier to predict the three most-likely folders for 
each message and provides shortcut buttons to quickly move each 
message into one of its predicted folders 

When one of the three buttons is clicked, the message is immediately 
placed into the indicated folder " 



SwiftFile Demo W 



l.-falxl 



Ta ErtaOtpi 



PERSONAL SYSTEMS AND ADVANCED SYSTEMS TECHNOLOGY 
COLLOQUIUM 



TiUo Lass is Mor o (Mwo or Less) 

Seme Thoughts on Momiafton App*anc*s 

Speaker BiU Burton 

CtieJ Saonost. Sbcon Graphics and Alias Wavgfrort he 
Associate Protescr. U-rversityoJ T-xcrto 

Dale. Tuesday December 1. 1998 
Ttira); 3:00pm -4 00pm. 

Location: AutJlortum (Rear) - YorKown 
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It has been found experimentally that SwiftFile provides the correct 
shortcut button between 80% and 90% of the time 
In this screen shot, we see that SwiftFile can effectively predict broad 
topics such as "Talk Abstracts" even though the contents of this folder 
have messages on a variety of different subjects 
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SwiftFile Demo < 5 ) 



n B5:J?.40AM 



fRSi , erriKnr^„ , US 1 ?- il1 - 0c ' «• »» 

-1CKI3-DIMST«CS ITKEC EDO n • d,,«i („. ol (K . „ ltMr , , 



Fro.: **d« H. CMCKXr ^udGMki i«CMtt U 
S^Iect'*"^' -l^t'-'V''^'-" ***** 



SwiftFile's use of three buttons improves its performance without 

placing any additional burdens on the user 

This message from the Agents mailing list should be filed in 

"Lists\Agents" - SwiftFile's second choice 

SwiftFile's first guess of "Conferences", although incorrect, is 

reasonable since the message contains conference announcements 



SwiftFile Demo < 6 ) 



MS 



i iM *"»' T **l Ust»VToytt«<ui 



beck S»rv*S*unS 
VyouMllnoiDvnMi, 
encVw iMNcti 
vcn»3u«tl cloy, p*l _ _ 

AJw. hi my piwviaut 
cnMMi pent tpmcl I 
*po«"ttB"»Bd ~ 




SMS- 



"1 
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Since SwiftFile only makes suggestions, there is little cost to the user if 
SwiftFile fails to predict the correct folder 

The user can just file the message using the application's normal 
interface 

This message cannot be correctly predicted by SwiftFile because it is to 
be placed in a new folder 
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59 SwiftFile Demo ( 7 ) 




When SwiftFile is first installed, SwiftFile uses the messages the user 
has currently stored in her folders to bootstrap its classifier 
After its initial training, SwiftFile continually monitors changes to the 
user's mail database and uses incremental learning to keep its classifier 
up to date 



SwiftFile Demo < 8 > 




* ' 10/26/3610.11 AM 



Soryfar *t* l&t* note*. I wo* wa,i«g tw tatna racial bock to *■ • * I can 9*4 iom» mom 
playcn n. but no rvtpon*** back ytl Rob Dafcnonico ha» efceded to diap out 0! th» 
ltagu«thH>»orduafc>*on\bad todyBioVJo^ha»now|wn*duv. Sinew Bob Lamey 
end StavaSfrwck piny qui* oftan aocn wail. 1 hova medtttm lot I in tyV waakttii 
MMMuMtHcongvt torn* new ptoyera. tlftaie it o ptoblern with *n. phl*m«|.ncw 
ThaVVad and Tuetlaagwa hat ebo tw**td. Aj aJwoya. yoou cenolnxift dw&y* ploy 
your ichadutad match an any o*«r day. 01 long ai you artiute a makt up court it raiarvad 
dumq «m plonnad eay and Wna. 



The user had to create a new folder when she received her first 
message about her racquetball league 

SwiftFile immediately learns about the new folder and predicts that 
future messages about racquetball should go in the "Racquetball" folder 
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Overview of Adaptation 




Evaluation 



• As was indicated above, studies have shown that SwiftFile 

• provides the correct shortcut button between 80% and 90% of the 
time 

• is only slightly less accurate even with newly created folders 

• One of these studies will be discussed in the section "User Studies" 

• What questions concerning SwiftFile's value for users remain to be 
answered? 
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Discussion ( 1 ) 



Task 



• c^forT 8 S ° me regularly recu ™9 task that requires many 
specific decisions and/or operations V 

• The task may involve devices other than traditional computers 
(e.g., cars, home heating systems) ^rnpuiers 

Normal division of labor 

• U makes the decisions and performs the operations individually 

Division of labor with adaptation 

• Strong form: 

• S makes the decisions and performs the operations on ZFs behalf 

• Weak form: 

' opera°tb[Is endS dedSi ° nS 3nd ° fferS t0 perform particular 



Discussion < 2 ) 
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Relevant properties of Zl 

• Preferences, interests, goals, etc. 

• Note: Most systems in this category don't represent such properties 
explicitly; instead, they learn behavioral regularities of U Pr ° pertl6S 

Potential benefits 

• Zl saves time and effort 

Limitations 

• Having S perform actions without consulting ft can have serious 
negative consequences in individual cases 

• Unlike a human assistant, S may not be able to recognize 
exceptional cases that require ZTs attention 

" Med 501065 C ° nSUlt U SaVin9S ° f time and effort for Uma Y be 
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Adapt an Interface 
« Smart Menus: Introduction 

s History 

| • Introduced in Microsoft Windows 2000 (including Office 2000) and 
S later in Windows ME ' ' 

x 

f | • Simple instance of a long tradition of adaptive menus 

Po 

— (D 

<B o 
1 E 

ft Basic idea 

il 

• Each menu initially includes only basic items 

1^ • When 11 clicks at bottom: 

-1 

%% * More items appear within menu 

|5 • Overall order stays the same 

s | 

|| • When 1/ selects a previously unused item: 

s« 

i£| • Item is thereafter included in the initial menu 



Smart Menus: Example 
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iJErtfu^nliiFor™ 

i! .:" "toahuelercWechseliv: ' 

i'- - . . . s T- fv.---'^ •' 

? CSeitpruahten . > 
H ' :,D'atunrvuncf Uhrzeit.. ; . 

r llpl xJ IHIliB 



1. 1i accesses 
"Insert" menu 



2. Not finding desired 
option, Zl clicks on 
extension arrows and 
selects "Feld" option 



ManueHer'Wechsel "X^, 



JlruBnbt'e: 





3. later accesses 
same menu 
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COUNTING 



APPLICATION OF RULES TO 
FREQUENCIES 





PRESUMABLY 
APPROPRIATE MENU 
CONTENT 




A Similar Idea: Split Menus 
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But BOS 

B Courier Bold 
B Times Bold 

Chicago 

Courier 
Garamond 
Geneva 
✓ Helvetica 
Hobo 

Los Angeles 
Minion 
MmtimEbdc 
Minion Bold 

Mtafan Scmibold 
Monaco 

New Century Schlbk 
New York 
Optima 
Palatine 
PC4 0 
PC88 

Ban PrandSca 
$□□□□□□ 



Courier 

■y Helvetica 

Times 



flthaoa 

B Courier Bold 
B Times Bold 

Chicago 
Garamond 
Geneva 
Hobo 

Los Angeles 
Minion 
IVfirtumEtuk 
Minion Bold 

Nfirdon Scmibold 
Honaco 

New Century Schlbk 
New York 
Optima 
Palatino 
PC40 
PC8B 



Alphabetical menu 




Up to 4 of the 
most frequent 
items 



Conventional 
order within 
each section 



Split menu 



Relevant Previous Evaluations ( 1 ) 



Advantages of "split menus" 

Basic idea 

• Like Smart Menus, split menus make the most frequently accessed 
items more easily available (see next slide) accessed 

Studies by Sears and Shneiderman (1994) 

• Comparison 

• Constant split menus vs. constant menus of other formats (i e 
no adaptation during use) 

• Advantages for split menus in field study: 

• Significant subjective preference 

• 17-58% faster mean selection times 

• Advantages for split menus in experiment: 

• Subjective preference over alphabetic and frequency-ordered 
menus y , ~" VJC,CU 

• Always at least as fast as alphabetic menus 



Relevant Previous Evaluations ( 2 ) 
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Drawbacks of automatic menu adaptation 

Comparison by Mitchell and Shneiderman (1989) 

• Static menus vs. menus automatically reorganized on basis of ZTs 
current pattern of selections 

Drawbacks of automatically adapted menus 

• Lower subjective ratings at first exposure and after practice 

• Lower speed and more errors during initial use 
|| • (No performance difference after practice) 

»| How to achieve benefits of menu adaptation with 
minimal disruption? 

II 1. How often and under what circumstances should menus be 
we changed? 

| 2 ' fJj° U ' d each Change be annou nced to U (and perhaps approved by 



S>co 
> o 

°—; 
TOO 



V _ 
■C o 

2— X 



3. Should an undo mechanism for adaptations be included? 
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• V works with one or more applications through a given interface 
Normal division of labor 

' « t0 d6al W " h ,he 9 iven '*■*<». perhaps adapting i. 
Division of labor with adaptation 

' £3£ Stf make ' m ° re SUitabl6 for « >»*«P- after 

• Types of modification: 

• How should input methods be adjusted? 

Keyboard properties, ... 
' What functions should be made available or highlighted? 

• How should aspects of the display be adjusted? 

Colors, fonts, ... 



Discussion ( 2 ) 
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Relevant properties of U 

• Noncognitive skills (e.g., motor or visual disabilities) 

• Tendency or ability to use particular functions 

Potential benefits 

• Saving of time, effort, errors, and frustration in using the interface 

• Avoidance of need to specify interface adaptations explicitly 

' U may not know what an appropriate specification would be 
Example: Optimal delay before a key starts repeating 

" otosedt MSLfttt made in -* —a, case, as 
^suitable choice of fonts and colors for each individual 
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73 Discussion ( 3 ) 



Limitations 



• Since some interface elements are used with high frequency, Zl is 
especially likely to become skilled in using them ("Level 2") 

• Consistency and predictability and therefore especially critical 
issues with this type of adaptation 
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Give Help 
Lumiere Prototype 
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K- v MiGi'o30ft Excel' - Book! 



Mi 

















What would you like to do? 
O Sort a list 

© Sort data in a PhrotTabfo 

O Default sort orders 

O When I sort, I do not get the results I 
expect. 

O Insert cells, rows, or columns 
▼ See more. .. 



Search ^) 



C Dps ) ( • Options J I ♦ dose ) 



Lumiere, developed at Microsoft Research, was the initial prototype of 
the Office Assistant 
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Overview of Adaptation 



US CURRENT GOAL, OTHER 

CURRENT STATES, AND 
LONGER-TERM PROPERTIES 



INSTANTIATION AND 
EVALUATION OF BAYESIAN 
NETWORK 



EVALUATION OF BAYESIAN 
NETWORK / INFLUENCE 
DIAGRAM 




V 



/US DESIRE FOR HELP? 
S UTILITY OF OFFERING U 
V. HELP 
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Relevant Experience 
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" Icf • b , 9Si . C , features of Lum 'ere are hard to recognize in the Office 
Ass.stant because of the inclusion of other mechanisms: 

• Lifelike behaviors unrelated to the adaptive features 

' MSSSS^r sophis,ica,ed mechanisms than th °- 
' SS^^^W 86 ^ by ,he same charac,ar 

' h3S inVeSti 9 a,ed »«• n,s of ,he 



Discussion < 1 ) 

• U finds out how to use an application successfully and efficiently 
Normal division of labor 

• U searches through documentation and engages in trial and error 
Division of labor with adaptation 

• U does basically the same things, but S gives hints to expedite the 
(j I umbo 

Relevant properties of U 

• Knowledge of the application 

• Current goal 

• Desire to be helped by S 



Discussion ( 2 ) 
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Potential benefits 
" less n frustration nt fUnCt '° nS and documen tat'on more quickly and with 

• ft discovers aspects of the application that U would otherwise never 
have known about 

Limitations 

• Reasonably accurate assessment by Jean be very difficult 

' behaTioT 301 pr0perties are usually refle cted only indirectly in <Us 
• Zl's current goal can change quickly 

• Interventions by S that aren't helpful can be distracting and 
misleading a 

Avoiding controllability problems 
' Joff e entirely) f ° r ^ ^ ' 9n ° re ^ Sp ° ntaneous advice ( witnout *™9 
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Support Learning 

ELM- ART 



I 49 B I i i Q § R 

Manual Tuloi H elp Motlel References Contents Sea.cn Remark Sialics LISP EVAL 



'Si LISP Coursa 

£1 Lesson 3 




Predicates 
g) Logical Punrtlnqt 
~* Control Structures 

Q exercises Usin g Condilinr>!>Hs 



Recom- 
mended unit 




The system assumes .some prerequisites must be met in ordeTrt^cessfu'lly work at this page' 
If you do not possess sufficient knowledge of this topici you'-are str^l^dvised to work at the 
,• following suggested page before continuing- " •' '"' — — 

.: • .-: ■-..=*■- r.-'-.i---. : Elm '. • .' 



Units 
assumed too 
difficult 



3-3 The Control Structures IF and COND 

^™^S^^ - * »* ■" «* sec*™ 

Continue. with the next suggested page ; 

'■ ' ■"" Pius - • 

ELM-ART is a web-based tutor for the programming language LISP 

Its link annotations indicate how accessible each part of the course 
currently is for 11 

It also recommends a particular page to be visited next 



ELM-ART: Pedagogical Navigation Support « 
Goals 

s 1 . Allow 11 considerable freedom in exploring the site 
| 2. Help 11 to avoid visiting 

£ • pages whose content 11 presumably already knows 
| Perhaps on the basis of previous learning elsewhere 

| • pages that 11 could not yet understand 
| Because 11 lacks prerequisite knowledge 

Is Form of hints 

s t, • Link annotations ("traffic lights") indicate the extent to which a visit to 
|£ a unit is recommended 

|| • A "Next Button" recommends a single unit to be visited next 
| j Underlying principles 

£ £ • S includes a model of the prerequisite relationships among units 

1 1 * Wnen a unit na s been marked as "known", S may infer that other 
Eds units are known 




INFERENCES ON BASIS OF 
PREREQUISITE 
RELATIONSHIPS 



CONSULTATION OF 
LEARNER MODEL 



C COMPLETION OF 
EXERCISES; 
SELF-REPORTS ON 
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f CURRENT SUITABILITY Of\ 
\ WEB PAGES I 
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5 CO CD ~ 



3 C (5 SS CD 

OT TO "(02 



Method 

' buton CtS: 33 US6rS ' 1 6 ° f Wh0m were 9iven access t0 a "Next- 
Results 

• Users with access to the "Next" button: 
1. Visited 80% more pages in all; p < .05 

• Result found only for the 14 learners without previous 
br^ereT" 9 kn ° W ' edge (m ° Stly Web novices - unfamiliar with 

2 s Ts^LTjr^ steps for usson 1 ■• differen - 

• No difference for later lessons 
Discussion 

• The "Next" button had noticeable added value only when the 
nav,gat,on challenges were especially unfamiliar to uSrs 

• More subtle effects might be found in a larger sample 
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Discussion ( 1 ) 

Task 

• S acquires knowledge and/or skills in some topic area 
Normal division of labor 

• S provides information, exercises, tests, hints, and feedback 

• Zl processes this material and learns 

Division of labor with adaptation 

• S performs basically the same subtasks but more strongly 
dependent on properties of the individual Zl 

Relevant properties of Zl 

• Prior knowledge and knowledge acquired during interaction 

• Learning style, motivation, viewpoints, ... 

• Current specific goals and beliefs (e.g., misconceptions) 
Potential benefits 

• Faster, better, and/or more enjoyable learning by Zl 
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Discussion ( 2 ) a 

Limitations 

• Decision-relevant inferences about the specific Zl may be difficult to 
make accurately 

• Decisions by S may not need to depend on such inferences 

• Example: S can teach a correct method without knowing what 
incorrect method Zl is currently employing 

Avoiding controllability problems 

• Ensure that the general principles underlying Ss adaptive decisions 
can be comprehended by Zl 

• Allow Zlto inspect the learner model 
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Conduct a Dialog 
Example Dialog With TOOT ( 1 ) 



Itvt P nf°i 0tyPe SP ° ken dial0g system T00T automatically adapts its 
style of convers.ng w,th 11 when it detects problems in the dialog 

Beginning with ambitious dialog strategy 

S: HUhis is AT&T Amtrak Schedule System. This is 
TOOT. How may I help you? 

L n S| d nJf?i a ! rain 9° in 9 t0 New York City! 
(ASR: DC I don't care on Thursday.) 

Which city do you want to leave from? 
Baltimore. 

Do you want me to find the trains from Baltimore to 
DC on Thursday at anytime now? 
No. 

How may I help you? 
I need to leave on Sunday. 
(ASR: DC between 1 night and 8.) 



U 

S: 
11. 
S: 

11: 
S: 
11: 



-5.29 



-1.73 



-2.09 



-4.91 



Note: Rightmost column: Js confidence in its own speech recognition 



Example Dialog With TOOT ( 2 ) 



After switch to more conservative dialogue strategy 

S: I heard you say go to DC between 1 night and 8 
Do you want me to find the trains from Baltimore to 
on Thursday between 1 night and 8 now? 
U: No. (ASR: Help.) ^ _ 2 8Q 

S: You can say yes or no. 
11: No. 

r -2.50 
S. How may I help you? 

U s n u^ O a^: t 3 O 0 N p e m WYOrkCi,yfrOmBal,imOreon 
(ASR: To Chicago Tuesday 8:45 am.) 

S: I heard you say go to Chicago on Tuesday around 
8.45 am. Do you want me to find the trains from 
now? 10 '' 6 lcago on Tuesd ay around 8:45 am 

11: No. 
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-3.35 
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^amplej^^ (3) 

S: Which city do you want to go to? 
New York City. 

Do you want to go to New York City? 
Yes. 

Which city do you want to leave from? 
Baltimore. 

Do you want to leave from Baltimore'? 
Yes. 

(. ■ ■ Same procedure for day and time ) 

S ' N^Yo^Ci^nnW the trains from Ba| timore to 
New York City on Sunday around 8:30 pm now? 

U: Yes. 

S: I am going to get the train schedules for you . . . 



S: 

U 

S: 

U 

S: 

U 

S: 



-1.67 



-0.77 



-1.44 



-0.60 



-0.58 




CLASSIFICATION LEARNING 



APPLICATION OF 
PREDICTION MODEL TO HE 
FIRST PART OF A DIALOG 



FEATURES OF SUCCESS^ 
FUL AND UNSUCCESSFUL 
DIALOGS 



:cessX 

ESSFUL J 



LIKELIHOOD OF SUCCESS 
OF CURRENT DIALOG 
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Evaluation (Summary) 



• Nonadaptive and adaptive variants of TOOT were compared in an 
experimental setting 

• Advantages of adaptive version: 

1 . Much higher rate of successful dialog completion (63% vs. 23%) 

2. Marginally greater subjective satisfaction 

• Adaptive TOOT adapted to different extents in different dialogs 

• (Further details in section "User Studies") 



Discussion < 1 ) 

I'l Task 

o to 

If • Achieve Ifs goals through a natural language dialog between U 

off and ^ 

Is I Normal division of labor 

ill ' V figures out what t0 sa Y in order t0 obtain th e desired results from 

»?s S 

3 c w 

Iff Division of labor with adaptation 

2 c £ 

||| * V expresses herself more or less spontaneously 

||| • S adapts content of utterances and/or dialog style to «^s 
•s|.£ requirements 

3 £ <D 

1 15 Relevant properties of U 

! II § * ^ s current information need, goals, and general interests 
f 8s t • Aspects of ZTs dialog behavior and/or speech 
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Discussion < 2 ) 



Potential benefits 
• Dialogs proceed more swiftly and/or more successfully 

Limitations 



Support Collaboration 
PHelpS: Getting Peer Help 
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PHelpS - Get Help 



gtBruceHowlett 
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S- X Assess suitability of ETA request If 
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i ^ Co to Sentence l^aflemajt 
^Setect 3: Sentence/Term jj 

i ^OetenUon Order or Reeetra'l 
IT onencfer is detained or 
_, : &Ko»ify offender* primary worKili 
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Functions (2) I Support Collaboration 
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PHelpS^ontext of Use 

Subjects and setting 

' S^^eS- Mana 9 ement » "sed the Correctional 

PHelpS suggests helpers who 

• are knowledgeable about the problem area of the specific task 

• are available to provide help in the time frame required 

• have not been overburdened with other help requests in the recent 

' lan"uate e as e S) Vant ^ ch — Eristics (e.g., speaking same 



Overview of Adaptation 




TRANSFORMATION INTO 
FORMAL REPRESENTATION 



COMPARISON OF TASK 
KNOWLEDGE 
REPRESENTATIONS 



USERS' 
SELF-DESCRIPTIONS OF 
TASK KNOWLEDGE 



f su 



SUITABILITY OF 
COLLABORATION 
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Functions (2) I Support Collaboration 
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PHelpS: Evaluation 0) 



Method 

• Subjects: 4 trainees (representative potential users) 

• 75 minutes: Introduction to S 

• 75 minutes: Performance of realistic simulated tasks 

• aSvitles train ' n9 r °° m: hdperS ° n dUty performin 9 d ay-to-day 

• Detailed recording of all proceedings 

Results 

• 7 help requests from trainees 

=> 7 help sessions 
=> 5 successful 

• All trainees preferred to choose a knowledgeable peer (as opposed 
to computer help or a training professional) 

• They were not concerned with helper's position in the job hierarchy 
or whether the helper was known to them 



PHelpS: Evaluation ( 2 ) 
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Quotations 



- .OO) 



0) S 

f}l! ' " PH elpS is very user-friendly... like step-by-stefprocessing, fully 
£|B knowing what to do next ... hierarchy is good" 

tx o £ 
E = 5 — 

* 8^| • "... getting the context right is tough" 

< c 2 a) 

is If 

III $ ' "hands-on approach is good ... some staff have more knowledge on 
8 1| | certain topics ... it is better to contact them when stuck" 

- rag o 

of is -a 

' being able to help someone else is helping you" 

■ Ol c = 
Wen o d 

-> ~ > ^ 



* ■'85 



• "I will contact a knowledgeable stranger to a less knowledgeable 



Tss- friend 



|||S • "Looking forward to seeing it (PHelpS) on the units" 
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Functions (2) I Sunnnrt Collaboration 



on a given task 



Discussion < 1 ) 

Task 

• U identifies persons who can work with u , 
Normal division of labor 

•U considers potential collaborators and assesses their suitability 
Division of labor with adaptation 

Relevant properties of 11 

• Knowledge, interests, ... 

• Willingness to collaborate, availability, ... 



of 



Discussion ( 2 ) 
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Potential benefits 

' SSiST and fod coll ^ora.ors that couldn't be identified 
Limitations 

' p"a~ be I'rtZ 01 m °™* of users, threats to 



Properties 
9}^T^L2ll^P^'ies Modeled 



1. Personal Characteristics 

2. General Interests 

3. Proficiencies 

4. Current Goal 



5. Noncognitive Abilities 

6. Behavioral Regularities 

7. Psychological States 

8. Context of Interaction 



^P!^L?!^^ Properti 



Personal 
Characteristic 1 



Knowledge- 




ability About 




To 


pic 





General 
Interest 




Specific Belief 



Specific 
Evaluation 




Personal 
Characteristic 2 




Long-Term 
Goal 



Short-Term 
Goal 



Noncognitive 
Ability 




"A => B" = 


User Action 1 




User Action 2 




User Action 3 


"A influences B" 
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Properties I Overview 



Questions About Properties 

Breadth of implications 

' ,0 " Varie ' y ° f decisions of s ° r <° 



Directness of decision-relevance 



• Can 5 take fPinto account directly when making a decision or dops 
J first have to make (uncertain) inferences on tL basis of 63 



Ease of assessment 
• How difficult is it in general to arrive at a reliable 



assessment of 2? 



O a" 
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References to 

personal 
characteristics 



jsutui: 




Ior e c ^ e l' th 5 0C ^.^"S system supports the generation of 
personalized medical information documents 
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Breadth of implications 
• Often quite high (e.g., for age, gender) 

Directness of decision-relevance 
' ^2qu^r' eriS,iCS sometim -^e| r? c, important 

• Example: What type of clothes a customer might want to buy 
' o^entSf 0 "' Pr ° PertieS Hke Preferences and are 



Ease of assessment 



swnf/by 8 ^ inf0rma "° n " ° ften a ' ready aVailable or °™>y 

in gSdiS °" basis of indirect eyidence is 



General Interests 
Modeling of Evaluation Criteria 
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n the Adaptive Route Advisor, the preferences of elch^r^^ 
represented as a vector of importance weights 

™^££?£££? h ° W U W ° U,d -ny given route if 
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Properties I General Interests 
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Discussion 



Breadth of implications 
• Generally high 



Directness of decision-relevance 

• Generally moderate to high 

Ease of assessment 

• Explicit self-reports can be fairly useful (see below) 

• Indirect inference is typically moderately difficult 



0.£T3x- 

£5 a c 

Q •- ° ^ c 
OS,,. S u 
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Proficiencies 
Proficiency in Lumiere 
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Automated 
assistance 



Lumiere's user model referred to an assessment of ZTs "competency 
profile" to help judge whether 11 needed assistance 

(This type of decision-theoretic model will be discussed in the section 
c* §>:§<Se "Inference") 
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Discus sion 

Breadth of implications 

• The more general the proficiency, the broader the implications 

Directness of decision-relevance 

• The more general the proficiency, the less direct the implications 
Ease of assessment 

• Self-reports can be of some use (see below) 

' a T ^,Sn 9 dTe e cT^e P noe flCienCy ' *» ^ ™ <* 

' proteiency d6nCe " e re P rese "<*e of the overall 

• Example: S wants to assess Vs overall knowledae of 



Current Goal 
Example and Discussion 
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Example 

• The previous graphic illustrates how the Lumiere D rototvn P 

Discussion 

Breadth of implications 

' ° nly t0 dedSi0nS th8t 5 makes in the ~nBnt 

Directness of decision-relevance 

• Generally high 

Ease of assessment 

• Explicit specification by a is often too inconvenient 

• Indirect inference is typically difficult 

• Observable actions may be compatible with various goals 
' U may be pursuing more than one goal at a time 
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Properties I Noncognitive Abilities 
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Noncognitive Abilities 
Taking Perceptual Limitations Into Account 



Lotai I'ntcptmn frit - 



WliiiiH 



n i ? a 4 5 s 7 r a in n i? 1.1 u 15 in w is ia m n ?? n ?i .n 'w ?7 n ?» .« 31 3? ,-ti 34 35 37 33 33 



Color pMcapdon Tut 



3 e 7 10 12 11 



32 30 28 29 31 



The graph critiquing system of Gutkauf et al. (1997) takes IZ's 
perceptual limitations (as determined via tests such as this one) into 
account 

For example, 5 tries to ensure that colors which 11 cannot discriminate 
are not used to make distinctions in a graph 



Discussion 
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Breadth of implications 

• Ranges from very high (e.g., generally poor eyesight) to very low 
(e.g., specific motoric impairment) 



Directness of decision-relevance 

• Typically quite high 

Ease of assessment 

• Self-reports are in some cases possible, but often U wouldn't know 
how to characterize a noncognitive ability 



Reliable objective tests are often available 
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r, ,i M o Behavior al Regularities 



|S Example 

ap?oinSs by Ca ' endar A ~*' wt"* helps « ,o soheduie 



._- o 

f s 

■alg 



J| • Position-of-attendees is Grad-Student, and 
• Single-attendee? is Yes, and 



2 

O T5 fc 
- <= <u 



• Sponsor-of-attendees is Mitchell 
Then 



f|| • Duration is 60 minutes 

m O O 

Comments 
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§ ra a 

<-> 5w 
5wc»> 
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Discussion 
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Breadth of implications 
• Low 

Directness of decision-relevance 

• High, for the same reason 

Ease of assessment 

• The inference methods are typically straightforward and reliable 

• They may require a large amount of behavioral data 
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Properties I Psychological States 
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Psychological States 
Transitions Among Emotional States 




Within the Affective Computing paradigm, a variety of 
methods are used to recognize and predict a user's 
emotional state 



Discussion + 

Breadth of implications 

• Relatively low 

•• The states are typically of limited duration 

Directness of decision-relevance 

• Often rather low 

• Even if S knows that Wis frustrated, distracted, or rushed, it may 
not be obvious how S should adapt its behavior accordingly 



Ease of assessment 

• Can be fairly high if suitable sensors are used (see below) 

• More tricky if behavioral symptoms must be interpreted 
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Properties I Context of Interaction 
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Context of Interaction 
115 Context-Sensitivity in Nomadic Radio 
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Level 

Message 
Priority 

Usage 
Level 

Conversation 
Level 
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/ p Jone leave; 

eeting 



" mee- 

/ 


tino ..." 

, - group msg"^ 


JiceCue- 

D ' 




< 


I5T " hi tiorn 


9 

C 


< 

i 


i 


c 


• 





1:1S PM 



1:30 PM 



Nomadic Radio takes into account environmental sounds and the 
intensity of Zl's system use in determining how to present incoming 
information a 



Discussion 
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Breadth of implications 

• Implications are largely limited to the current situation 

Directness of decision-relevance 

• Implications are often quite straightforward 

Ease of assessment 

• Some aspects of context are more or less directly accessible to 5 

• Example: What applications 11 is using 

• If appropriate sensors are available (see below), other aspects can 
be assessed straightforwardly 



• In other cases, difficult indirect inferences may be required 
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input I Overview us 

\ Input 

Overview of Input Types 



Explicit self-reports and -assessments 

1. Self-Reports onPersonal Characteristics 

2. Self-Reports on Proficiencies and Interests 

3. Evaluations of Specific Objects 

Nonexplicit input 

4. Responses to Test Items 

5. Naturally Occurring Actions 

6. Indices of Psychological States 
7- Evidence About Context 



-5y^*!°I!iAbojjt[nput Types 
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Frequency 

• How often is input of the type / typically acquired? 
Additional activity 

' re 0 q e ut e / d? qUire ^ aCt,Vity by ^ that would not otherwise be 
Cognitive effort 

• How much thinking and memory retrieval does / require from 111 
Motor effort 

• How much physical input activity (e.g., typing) does /require? 
Reliability 

• To what extent does /allow <> to derive precise accurate 
assessments of properties of W ^accurate 
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Self-Reports on Personal Characteristics 
119 Personalizing BroadVision's Web Site 



to 
£ 

0) 
(0 



BROADVISION* 

Personatcung c-Buscvii" - 

0 Personalize This 

Site 
o Login 

o BroadVision News " 



"Because our customers are so diverse, one 
message will not satisfy them all. We set the 
business rules in BroadVision to show only the 
products, services, and solutions that a 
' particular visitor will be interested in." 

Lode Van Ssten, E-commerce Manager. 
Business Customer Division, Belgacom 
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Homo Contact Us Site Map Careers Privacy 



Personalize This Web Site 



By simply providing us with some information about yourself, our Web site will chanoe to 
better meet your needs. " 
* Fields marked with an asterisk are required. 

First fi ~ Last r= 1 

li , J Name" 1 



Name': 
Title - : 1~ 

Address 1': |F 

City: F 



-Choose One- 



Address 

2: 



State (US i~ " — 

on |yj. i Please select one 



Canadian 
Province: 



Postal 
Code": 



Please select one r u 



Fax 



Country*: j Please select one ci | 
Phone: |i ~ 
E-mail': (i 



J 



Discussion 



Frequency 

• Typically only at one or two 
points in a dialog 

Additional activity 

• Usually, there's extra activity 

• But in some cases 11 might 
have to supply much of the 
same information anyway - 
e.g., to place an order 

Cognitive effort 

• Generally little 

Motor effort 

• Often a lot - unless easy 
copying from other information 
sources is supported 



Reliability 

• On the whole high 

• But there may be distortions if 
sensitive issues are involved, 
or if seldom-used information 
has to be recalled from 
memory 
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Self-Reports on Proficiencies and Interests 

1 J1 Examples] 1 ) 

How important to you is a dog that's easy to train? 

Some dogs are more stubborn than others. If you want a dog that will learn and 
obey your commands, place more emphasis here. If you don I plaSto teach Jour 
dog more than a few tricks, this wont matter much V 



' No* ,** I " -f 
Opinion Somewhat" Very* 



v v v *v 

In PersonaLogic, W often specifies a preference on a 5-point scale 



Done: 



jGheckiM; 



icTiww.. .j,..----;, 17 Machl " e L"--"-^ 17 B«y».<m ClMafim 17 Fust Order Lope ' . 

|?f f??^^? ^Psychology F^Mecfccin, RApphc^S^rlS^ ■P^ L «« U i, 
gnUjhgent Agents, jy.NeAal^U |7,Th«ory RMOdUpl. Modi ? ; ' X ' ' ,'. Sf^^ ^'^T 'VHS 



In the Publication Recommendation Agent, U can give^ina^^" 
self-assessments of a number of interests within a small dialog box 
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Examples < 2 ) 
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|$ Escorted Temporary Absence 



H Irtttlai assessment of ETA request 



Co to Sentence Mam gems'!! 
Select 3: Sentence/tern Jr|t 



Select 6! IERM-INCAK.CER 



■^r Detention Ordet or Rdc'omMl 
^ If QfFeti<&r is 4 ctainod <w r Jf!§ 
J ^Notify otfendens primary wortjf* 



With PHelpS, U can report her proficiencyirparticula'r tasks at various 
levels of granularity 
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Input, Self-Reports on Proficiencies and interests 
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Frequency 



• Typically only at one or two 
points in a dialog 

Additional activity 

• There's almost always extra 
activity 

Cognitive effort 

• May be high, if zi tries 
seriously to give a reliable 
assessment (see below) 

Motor effort 

• Little 



Discussion 

Reliability 



Sometimes low: 

• U may not know the exact 

meanings of the reference 
points given 

• U may be motivated to give 
an inaccurate 
self-assessment 
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Evaluations of Specific Objects 

Example 
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Input I Evaluations of Specific Objects 
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Discussion 



Frequency 

• Typically, many evaluations 
are given 



Additional activity 

• Usually, there's some extra 
activity 

• Though it's not much of a 
burden in each individual 
case, the total effort can 
add up 

• Users often don't bother 
with even simple 
evaluations 



Motor effort 

• Can be reduced to a single 
mouse click 

Cognitive effort 

• Low; usually a spontaneous 
reaction is expressed 

Reliability 

• Often fairly high 

• The same problems as for 
general interests may arise 
to some extent, but the 
concreteness of the 
judgment makes it more 
reliable 



Responses to Test Items 
Example 
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In principle, it is even possible to call «+» without any arguments. (+) returns 0 as its result. 

Exercises: 

What is the result of the function call 
(+ 3) ? 



r 



I What is the result of the function call 

8 (+) ? 



CO 
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| In a learning environment like ELM-ART, tests and exercises 
| simultaneously serve other purposes, in addition to supporting 
| adaptation 

1 (See also the color discrimination test of Gutkauf et al., 1997, presented 

2 earlier, which can be presented as a sort of game) 
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Input I Responses to Test Items 
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Discussion 



Frequency 

• Tests can be administered at 
a single point, or at regular 
intervals (as in educational 
systems) 

Additional activity 

• If the test items are also used 
for practice and for learner 
evaluation, 11 may have to 
deal with them anyway 

Cognitive and motor effort 

• These depend on the nature 
of the test 



Reliability 

• Generally high: 

* Test items can be selected 
administered, and 
interpreted through 
well-understood, reliable 
procedures 



Naturally Occurring Actions 
Example 
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Discussion 



Frequency 

• There may be a great number 
of relevant natural actions - or 
only a few if a very specific 
type is involved 

Additional activity 

• Usually there's no extra 
activity 

• Sometimes, ostensibly natural 
actions are invoked by 
disguised tests 

Cognitive and motor effort 

• Can vary greatly; but not very 
important, since the actions 
will tend to be performed 
anyway 



Reliability 

• Naturally occurring actions 
can be reliable indicators of 
specific beliefs and attitudes, 
but less so of generally 
relevant properties of U 
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_ Indices of Psychological States 

-EjSglHPlgLjg^glQL^r-Affec tive Computing 
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I SenSors °n the body can help J to detect Us emotional state 



Is 

U 
> . 
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Input I Indices of Psychological States 
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Discussion 



Frequency 

• Where the necessary sensors 
are available, a large amount 
of input data can be acquired 

Additional activity 

• Since most people wouldn't 
wear such sensors otherwise, 
any associated effort is usually 
extra effort 



Cognitive effort 

• Typically none, since 11 
doesn't have to give any 
explicit input 



Motor effort 

• Sensors can be cumbersome, 
but technological advances 
are continually reducing the 
burden 



Reliability 

• Fairly high for some 
psychological states that are 
closely associated with 
measurable symptoms 
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Evidence About Context 
Example 
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The tiny camera and microphone pick up low-level features of the 
environment in which U finds herself at the moment 
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Input /Evidence About Context 
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Discussion 



Frequency 

• The amount of data that can 
be acquired is limited only by 
the technological possibilities 
and the amount of available 
information that is worth 
collecting 



Reliability 

• Depends on the degree of 
precision required and on the 
available technology 



Additional activity; cognitive 
and motor effort 

• U may be required to specify 
some information about the 
context 

• Technological advances make 
it increasingly possible to 
acquire enough information 

. without effort by 11 



Inference 

to Inference 



1 . Classification Learning 

2. Social Recommendation 

3. Decision-Theoretic Methods 

4. Application-Specific Procedures 
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Classification Learning 
^Brief Introduction 

Scope 

• Large family of techniques in machine learning field 

• Various types of models can be used 

representations from information retrieval, . a ° rSpace 
Nature of problem 
Given 

• A set of classified examples 

• A type of model for classifying individual cases 

• Example: decision trees 

• (Optional:) relevant background knowledge 
Produce 

'lfeef^es ne£/m0tfe ' thataCCUra,elyclassffies P revi °"^ 
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Inference I Classification Learning 
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Overview of Adaptation 




CLASSIFICATION LEARNING 



~~w 



APPLICATION OF MODEL IN 
SPECIFIC CASES INVOLVING 
A GIVEN U 





fBEHAVIOR OF A SINGLE 
\ [OR A SAMPLE OF US] 

The learning may be done for: each individual user, users in general, or 
some combination of the two 

Note that classification often amounts to prediction: 

"This web page is classified as 'interesting for this II" 

=> "It is predicted that this U will be interested in this web page" 



Systems That Use Classification Learning ( 1 )? 3 
SwiftFile 

• A distinct model for classifying email messages is learned for each 
user 

• The learning method was designed so that the representation of 
each folder can be updated quickly when a new message is filed 

S into it 

o 
o 

I TOOT 

§ • In off-line training, TOOT learned to classify dialogs into the 

| following categories on the basis of features of the initial utterances: 

l 1 . "Good dialog": Percentage of semantic misrecognitions < 1 1 % 

•I 2. "Bad dialog": [All other dialogs] 

| • There is no additional learning for each individual user 

| • The general model is simply applied to each user 

| • Whenever the current dialog is classified as "bad", S switches to a 
£ more conservative dialog strategy 
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Systems that recommend documents 

Examples of document types 

• Web pages 

• News stories delivered via wireless media 
Given: 

1. Features of documents that 11 has seen 

Keywords, words in text, genre, length, language, ... 

2. Some indication of how U liked each document 

Explicit rating, downloading, viewing time ... 

Learn: 

' wiSe^ PrediCtin9, ° n the basis of Matures, which documents U 



Discussion 
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What is needed for learning? 

1 . A set of discrete categories of interest 

2. A set of features that in principle could allow S to discriminate 
among the categories 

3. A reasonably large number of observations for learning 

• For general user models: 

• Observations can be obtained from a large number of users 
and analyzed off-line 

• For individual user models: 

• It may take a long time to acquire enough data 

• Ways of reducing this time are a key topic of research 

What is needed for classification or prediction? 

Information about the features of the current case 

• (Usually not a problem) 
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Inference I Social Recommendation 

Social Recommendation 
General Remarks < 1 ) 



Other terms 

• Collaborative filtering 

• Social information filtering 

Drawbacks of these terms 

• The approach is not useful only for routine information filtering 

• Also for processing explicit requests for recommendations 

• Active "collaboration" of other users is not required 

• Stored data about their choices are simply exploited 

Scope 

• The term covers a variety of specific algorithms 

• New variants are continually being developed and tested* 
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History 

• Introduced in the late 1980s and early 1990s 

• Now widely used commercially: 

• Best known single application: 

http://www.amazon.com 

• Two of the firms that sell the technology: 

http://www.netperceptions.com 
http://www.likeminds.com 
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Inference I Social Recommendation 
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w Overview of Adaptation 




MovieCentral: Summary of Procedure U4 

Identifying mentors 
I 1. Store lis ratings of movies 

| b 2. For each If in a sample of other users, compute an agreement 
|| strength with 11 on the basis of 

difference between ratings of IT and 11 
number of objects rated by both IT and 11 
1|| 3. Identify a set of mentors for 11 on basis of 
||| • agreement strength with 11 



8* 



, ti — 



I § d • total number of objects rated 
f |JL * extension of total item coverage 



lf|? Making predictions and ratings 

§?!! 4 - For eacn item ' use mentors' ratings to compute 
8 • predicted rating by 11 

°tli • confidence in prediction 

1 1 1| • disagreement among mentors 

o s at 5. Base predictions and recommendations on these factors 
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Inference I Social Recommendation 
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Discussion 



What can it provide? 

• Predictions as to how a u will respond to a given set of objects O 
What is needed? 

• Database with ratings by many users of many objects 

• Ratings are usually explicit, but they may be implicit 

• ^n^ aCh ^° bjeCt °' at least some ratin 9s ^ this database should 
concern (_/ 

• Hard to fulfill when new objects continually enter database 

• Moderate number of ratings of various objects by the current U 

• Until these are obtained, Wean perhaps be kept satisfied with 
recommendations derived by other means 

Other limitations 

• In the basic procedure, no straightforward way for mo express 
preferences directly express 

• Example: "I don't like science fiction movies!" 



8iU 



ce tLuf 

. C CO Q) c 

°lj|f 

a E o *> P> 

E 3 

■g.!SO g.<2 E 

. <D C ^ f\j 3 

0 0) (B c- Q. S 

1 £ a> S ■= » 

•s s lH 



Decision-Theoretic Methods 
Influence Diagram from Lumiere 
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Inference / Decision-Then^ Methods 
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Basic Concepts 
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Bayesian networks 

' ^tabta""* ^ " 8 BayeSian ™ (BN) corresponds to a 

' In user-adaptive systems, most variables refer to properties of Zl 
These may be observable or unobservable 

' dtotffi^ 6aCh Vanab,e iS re P res -ted as a probability 

When thTJT T S tyPiCa " y rePfeSent Causa ' infl -nces 
"nstlTlT 6 ° f 3 V3riab,e iS ° bserved - corresponding node is 

' o T thl e vi;S ° f BN th6n ' eadS t0 revis ^ beliefs about the 
Extension to influence diagrams 

• toMuenas diagram also contains decision nodes and value nodes 

• Through the evaluation of an influence riianr*™ c /? 
which decision is likely to yield t h.ghest'value * ^ 
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What are these methods especially good for? 

' e^n n c 9 e eXPliCitly Un08rMn be,iefs °" ^ °f limited, unreliable 

• Sv s ter»?' e: i , U , haS , made 3 SinQle miStake: what does « imply? 

Examples. Offer a help; don't distract « from work 

• ^explicit the oonsiderations underlying Ss inferences and 



Ull What is needed to build the models? 



*J.S"? ' 0ne or both of: 



O) cz CJ « 
CD ° Q.3 



• Knowledge about causal relationships and probabilities 
SSSi?*^ ' earnin 9 cau -' -lationships and/or 
|||| What is needed in use? 

' ^^r ablB 6VidenCe Can rise to a useful 
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Types of application-specific procedures 

Hand-coded rules 

• The designer simply specifies, in some formalism what ci« 
supposed to do in particular circumstances ' 

• Possible bases: 

• Input from domain experts 

• Designer's own experience, common sense 

Computational procedures 

• Possible bases: 

• Quantitative cognitive model 

' Off-line statistical analysis of data 



_Examplesj>^ 
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Cancer system 
• If U has asked for information on her "problems" 
| r T e h cord dynam '' Ca ' ,y 99nerate 3 page on the basis of medical 

u. 

I ELM-ART 

V) 

§ ' ,f u nas sh °wn she is familiar with concept C 

| ' Then no longer discourage U from visiting pages that 
b presuppose knowledge of C 9 

o 

I Smart Menus 

2 

| • If U has selected option O in menu M at least once 
* ' Then include O in the main part of M from now on 
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I^a^^u'T 8 3 9iV6n ° Pti0n int ° the high-frequency 
• Compute the expected fcene/tf of doing so according to 
[a formula based on a cognitive model of menu selection] 

' SIS 6 Wh6ther the 6XpeCted benefit exceeds ^ given 



Note 



CO 



The authors presumably would not advocate using the formula to 
change a menu during an interaction 9 t0 

' It does not take the costs of adjustment by Zl into account 



When are application-specific procedures best? 

• For many simple, straightforward inferences and decisions- 

• Easy to implement 

• Easy to communicate about (if simple) 

When should more powerful techniques be used? 

• When problems are more complex: 

• Large number of features to consider 

• High degree of uncertainty 

• Quantitative tradeoffs 

' can be empirica " y detemined but ,hat are not 

Are the more powerful methods hard to work with? 

' SOftWare PaCk39eS mate ^P'emeniation 
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User Studies 1 Introduction 
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User Studies 
Overview 




1. 


Wizard of Oz Studies 




2. 


Simulations With Existing Data 




3. 


Controlled Studies 




4. 


Studies of Actual System Use 





Focu s m 

Applicability of standard empirical methods 

' s^sTems ^ GmPiriCal mGth ° dS a ' S ° a PP |icable to user-adaptive 

• Possible reasons for infrequent use 

• Designers often trained in other areas than HCI or psychology 
(e.g., artificial intelligence) yy 

• Frequently great effort needed to get a user-adaptive system to 
adapt reasonably in the first place 



Focus in this tutorial 

• Here, we focus on issues and methods that are (relatively) specific 
to user-adaptive systems «"ve,y; specmc 
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User Studies I Introduction 
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Questions of Special Interest 



Accuracy of modeling 

• S typically derives testable predictions about each individual user \ 

• Reasonable accuracy of the predictions is usually a necessary 
(though not sufficient) condition for overall success 

• It can be hard to know the implications of overall usability results if 
the accuracy of the modeling is not known 

• Also, how fast S attains accuracy for a given Zl may be important 

User acceptance of adaptive features 

• Problems of control, predictability, and appropriate timing may be 
most clearly reflected in 

• Subjective ratings 

• Ignoring or turning off adaptive features 



Wizard of Oz Studies 
Wizard of Oz Study for Lumiere < 1 ) 
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< • Worked in a separate room 



| • Were not informed about the assigned spreadsheet tasks 



| Experts 



I • Conveyed advice by typing 



| • Viewed subjects' activity via a monitor 



Subjects 



Method 



• Received the advice via a computer monitor 



• Were told an experimental help system would track their activity and 
make guesses about how to help them 
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User Studies I Wizard 0 f Oz Studies 
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Results 

Difficulty of experts' task 

• Experts showed some ability to identify ^ s goa is and needs 

• They were often uncertain about 

'■ S^ 8 »S32! me8 reC ° 9niZed With an " Aha!,, ™ «on after a 
• the value of providing different kinds of assistance 
Consequences of poor advice 

• Users typically examined advice carefully 

' recognS" *™ ^ COnfirmati - °f successful goal 

• Experts then gave further advice along the same lines 



Results (continued) 

How experts improved 

• Experts became more skillful in offering advice in this situation 

• For example, they learned to give conditional advice: 
• "If you are trying to do X, then..." 
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Discussion 



General idea of Wizard-of-Oz 

• A human takes over some aspects of Ss processing 

• U may believe the system is fully computerized 
Assessing accuracy 

• If humans are better than any likely system 

May say little about actually attainable accuracy levels 
Assessing acceptance 

+ Some acceptance issues can be investigated much more cheanlv 
than with an implemented prototype cneaply 

• Example: Whether users find Ss adaptations basically helpful 
- Acceptance may depend strongly on details not included in the 

' be^vior : D '' Stractingness of a ^ agent's appearance and 
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Simulations With Existing Data 
Suggestio n J Ac^ujgcj^^^wiftFile 

D C ■ ~ ■ . 
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Upper curves: 
SwiftFile 



80% -, r 
2 60% 



< 40°/, 
20% 



Lower curves: 
Presentation of N 

most frequently 1000/o 
used folders 




/(Buttons #Bii» 

Given just a user's existing email folders it is oo«ihio to ,w 
™^ f ^ c „e,., different 
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Discussion C) 



Basic idea 

Given 

• Detailed behavioral data on system usage by a number of users 
Procedure 

1. Simulate a use situation in which S receives the data incrementally 
as input ' 

2. Check how fast and well S can 

• Learn the necessary model of 11 (where applicable) 

• Make predictions about 11 
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Assessing accuracy 

+ Precise, thorough analyses can be performed without investment of 
users' time 

+ Alternative versions of S can be compared on the basis of the same 
data 

• Alternative learning or inference procedures 

• Alternative system behaviors (e.g., number of "buttons" offered) 

- The influence of ^s adaptations on Us behavior cannot in qeneral 
be taken into account 

• Yet 11 may be more difficult (or easier) to model when 11 is 
interacting with an adaptive system 

Assessing acceptance 

- In general, there are no results concerning acceptance (aside from 
indirect implications of accuracy) 
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763 SMes / Controlled Studie s 

Controlled Studies 

Subjects and dialogs ^ 

; ssn r sys,em version tnonadapti - -*•» 

TnSyT 96 ^ ^ dia '° 9 Strat ^ - s 

• 19 out of 24 
Frequency of adaptation per subject 
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3 


3 


1 


2 


2 


1 


0 


0 


0 



^^PtiYevs^Adaptive TOOT 



(2) 



Nonadaptive S 



Overall indices 

Evalua tion Measure 

Objective indices. 

Task success 

Number of 

misrecognized turns 

Number of system turns 

Subjective indices: 

Self-perceived user 
"expertise" (1 to 5)* 

Overall user satisfaction 
(8 questions, includinq 
expertise") 

2\^r se ' "■ " Did you know what ^^ 
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23% 


65% 


.01 


6.0 


3.9 


.15 


17.4 


13.7 


.28 


3.2 


4 


.09 


21.6 


25.6 


.20 
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User Studies I Controlled Studies 
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Discussion 0) 



Procedure and benefits 



Assessing accuracy 

♦ Precise, quantitative accuracy assessments may be possible 
- The accuracy of the adaptive version may not be assessable 

" asS b ^ ° n ' y after a of use may not be 



Discussion ( 2 ) 
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Assessing acceptance 

• Time pressure 

• Complexity of the entire set of tasks being dealt with 

• Focus on the content of a personally significant task 

• Availability of alternative systems (perhaps "one click away") 
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Studies of Actual System Use 
Evaluation of Cancer Information System < 1 ) 



Subjects 



O CO 
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£ 5 



t 5 reatment ntS reCmited ** Start ° f 3 C ° UrSe ° f radical radioth erapy 



s|R System use 
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• During initial consultation session 

• (Optional:) In waiting room before subsequent treatments 

Adaptation 

• No adaptation within sessions 

• Information presented changes only when medical record changes 

• So the comparison is between nonpersonalized and personalized 
information presentation 



Evaluation of Cancer Information System < 2 ) 
Patients' evaluation of information presented 

Question asked General Personal Difference p 
(%) (%) (%) 
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Positive aspects: 

Was information useful? 

Did it tell you anything 
new? 

Was information relevant? 

Find information easily? 

Negative aspects: 

Feel overwhelmed with 
info? 

Was it too technical? 
Was it too limited? 
Overall index: 
[Satisfaction score > 2?] 
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0.004 
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-6 


0.41 
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0.04 
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42 
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User Studies I Studies of Actual System / 



Marginal tendencies favoring personalized version 

• More use of computer after first session 

' ~=or^^T ™ - 

• Greater tendency to look at printouts of session at home 

Open question 

• Patients using personalized version received- 

1. personalized explanations of medical topics 

2. a basic summary of their medical record 

• Might the positive results be due solely to the second difference? 
Cautious conclusion 

• assess — ■ - 



Disc ussion 

Assessing accuracy 

+ avS ^ " SUitab,e behavi ^l indices are 

• Example: S makes suggestions, Zl chooses whether to adopt 
- Behavioral measures can be misleading 

' feZlslel effort SU 9f h stions dimply because it 
£ infLted t0 "° S °'' the '' ndeX ° f ^ s P redicti °n accuracy 

' atS,e° ntr0l,ed StUdieS ' 6Vidence on a^uiacy may not be 

Assessing acceptance 

' a"Tec" d n eT g y n COme '°° ' a ' e '° lnfluen » ftm *™nW 
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Workshop I Overvie w 

Workshop 
^^urejo^^^ Sessions d) 



At beginning of Session 1 

• Groups of about 4-5 participants are formed 

During Sessions 1-6 

• Goal for session is explained briefly by instructor 

• Each group works out ideas using flip chart 

' CH ' 2001 Site < in n-t 

' S^'hSSS! 1 9r ° UPS rep ° rted t0 a » Participants and 
" ^K?uE 3 9iV6n S6SSi0n wi " first in 



-^^y^foM^ Sessions 



(2) 



Ot/r/A?g Session 7 
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' ^me^SSSp ,nt ° 9 C ° herent for CH. 2002 (insofar 



After the tutorial 

' CH. S |nn e 9 r 6ditS the proposal int0 a form 
^Ml 2002 organizers 



suitable for presentation to 



Group work continues until: 
Reports from groups continue until: 

From among the three types of adaptation considered so far think of 
one type that might be useful in the context of the CHI web site 

1 • Sketch a scenario in which this type of adaptation is applied to a site 

• Use telegraphic text and perhaps a drawing or two 

2. Make some notes about the extent to which problems of 
controllability might arise in this scenario 

For now don't worry about how S might acquire the necessarv 
mformation about 11, unless some interesting ide££^£u 

' wS! ^^a^ necessary judgments about Zl 

' wou,d ,00k - and 




Possible examples 

Feel free to ignore the hints if you already have ideas of your own 
Help U to Find Information 

' ll3?Z^Z° id6n,ify imereStin9 *™«™™ >" >he 
Tailor Information to Zl 

' ^l^^l^^T 1 ? 11 Ce,1ain Pa9es (e -9- tne introductory 
page) is adapted to particular properties of U 

Recommend Products 

• S helps Zl to find a suitable hotel 

• Note: If the approach exemplified by MovieCentral doesn't seem 
appropnate, consider having S base its recommendaJ.ons on 

• Explicitly expressed evaluation criteria of U(as with 
PersonaLogic) v 

; Evaluation criteria inferred from particular information about Zl 



Worksho p I Session 1: Functions 

Notes ( 2 ) 
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Workshop I Session 2: Functions (2) 
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Session 2: Functions (2) 
Session Goal ( 1 ) 



Group work continues until: 
Reports from groups continue until: 

The six functions of adaptation just discussed have less obvious 
applicability to the CHI web site than the first three functions 

Still, with some imagination you should be able to find a potentially 
useful application for one of these types of adaptation: 

1. As in Session 1, sketch a scenario in which this type of adaptation is 
applied to a site visitor 

2. Once again, consider the extent to which problems of controllability 
might arise 3 



Session Goal < 2 ) 
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Possible examples 

Help With Routine Tasks 

• For the frequent site visitor, S offers shortcuts to specific paqes that 
U is likely to want to visit 

Adapt an Interface 

• Are there elements of page layout that might be adapted 
automatically to users with perceptual or motor limitations? 

Give Help 

• Are there parts of the site where U might need help in performing a 
task (other than finding relevant information)? 

• Uploading a submission 

• Registering for the conference or for accommodation 
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'a* Notes ( 2 ) 
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Workshop I Session 3: Properties 

Session 3: Properties 




If you finish early, you can consider the other scenario as well 

• SSS,^ any others that 

• For example, if S spontaneously offers advirp c minhf ^ 

' a L sse* V h a em Pr0PertfeS eVen * y °" ,hink itwouM b * for5to 



Session Goal ( 2 ) 



* a'nsSgTisTuestr " B9n9n " C ° mpUter 

' .hi SSST m ° re Sys,e ™ tol ^ in *• "ex, two 
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Session 4: Input 
™ Session Goa l 

Group work continues until: 
Reports from groups continue until: 

Again, please address the following question in relation to one of the 
scenarios you have worked on so far 

• Design a particularly appropriate or novel way of obtaininq 
information about the user that could be used as a basis for 
adaptation 

• All of the types of input discussed are potentially relevant, thouqh 
some may only become technically feasible in later years 

• If you choose a familiar type of input element (e.g., a rating scale) 
or an obvious type of naturally occurring action (e.g., web page 
visits), try to introduce some appropriate innovative element 

• You may wish to illustrate your idea with a drawing (large enouqh 
to show to all participants using the flip-chart) 



Notes < 1 ) 
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1 SS^IT^ br ° ad aPPr0aCheS '° infere " Ce ~™ ™< 

2. Outline how the inference task could be handled by filling in our 
basic inference schema in a fairly concrete way 9 

" ^tes^^ SCh6maS Pr ° Vided ° n the next two PWS for your 



Notes ( 1 ) 



198 




Group work continues until: 
Reports from groups continue until- 

2. List the main features of the study, including the following points: 

• Which variant(s) of S will be employed? 

• What indices of success will be used? 

3. What are the main questions that you expect to be answered? 

' —eTis'sue? f ° CUS " 3CCUraCy - 9CCeptanCe - or 
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Session 7: Synthesis 
Session Goal 



This final session is a plenary session 

We will review the proposals that have been discussed and select a set 

• seem most promising, after all aspects have been considered 

• can be integrated into a fairly coherent high-level design proposal 

' eva^ated 1 ^ 35 ^ h ° W ^ SySt6m iS t0 be im P'^ented and 

XSr teS ' We Wi " diSCUSS ^ s that are 
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Notes ( 2 ) 
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CHI 2001 Site I Main Page, Site Map 
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CHI 2001 Site 
Introduction 



• This section shows a representative sample of pages from the 
(nonadaptive) web site for CHI2001 

• Date of screen shots: Beginning of January, 2001 

• The pages are intended to support concrete discussion of how 
site for V CHI2002 ^ ^ intmdUCed int0 *he corresponding web 



• The pages appear here in the same order as in the site map ( 
next page) K v 



see 



• During the workshop sessions, each group will probably choose to 
focus on a small number of aspects of the site 



Home Page 
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IHTROOUCTlOiJ 
S OVERVIEW 



Shortcuts: 

Online 

Conference 

Registration 

Online Hnusinn 
Begistration 

Deadlines 

Sponsorshi p 
Opportunities 

Kecrultinn a; 
CHI 2001 ■ 

Exhibits 



Keynote Speaker 

* Bill Gates 

Chairman, Microsoft Corporation 



CHI 2001 

anyone, anywhere. 

Stunk. Washington 1,'SA * 31 March- 5 April 

The CHI 2001 Conference on Human Factors in 
Computing Systems will take place in Seattle 
Washington, 31 March-5 April 2001. The 
annual CHI conference Is the leading 
International forum for the exchange of ideas 
and Information about human-computer 
interaction (HCI). 

Content Areas 

The I ntroduction and Overview Introduces the 
CHI 2001 conference, its theme: anyone. 
anywhere., the conference committee, and 
Includes PDFs of the Call for Participation and a 
conference poster. 

The Call for Partir r ipfltinn pvpi-in^ ^ 
opportunities for submitting papers, tutorials, 
workshops, and a wide array of other 
presentation formats. 

The Advance Prngrpm helps you prepare for 
attending CHI 2001, providing Information on 
hotel accommodations, conference registration 
the technical program, and a variety of 



Introduction and 0»pr»i M i, 



° What's IMpw? 

O Conferenr.P Thprn* m Sprrh| . 

0 Conferennp f! m ^ 

° Conference Partnnro 

° About ACM and S_K2£HJ 

0 £onference Pos ters 

° Call for Parti cioatinn Pnr<= 



0 Call for Partjclnatian 



. ° Submission P rocess and Fn rmat 

° p^de to Successful Pap P rs *„^;„ :m 
0 Cover Panp Instrurrinns 

0 VolUntPPlinq 

o Mentoring 

° Request a Mentor 
° Volunteer rn P, e a Mpntnr 
at the Reviewer Volunteer Centei 
this site) 

° Volunteering to Rsvipu; C 
° Student Vnliinfppre 

0 Student Volu nteer A ppliratinr, 



Sponsorship Qonnrtunitips 



° Particinatinn r . : a tennriPs 

° Demonsfr atigns 

_ ° Samolfi npmn nstratinn Prn pr,sg|o 

Design F^ pn y — aa 

Pevelorimpnt Consortium 
Doctoral CgjTs^rtjum 

° Sample nnrtoral Consortia 

Submissions (off this site) 

Exhibits ' 

Recruiting at pmi ? qq 1 
Panels 
Pagers 

Short Talks anH in feractiup Pn^rc 
Special IntPrasr r; r niips 

° Sample Sppnial Interest Groups • 
Submissions 
0 Student Pnstars 

o U°l amDlR St " riPnf P "°'° n 9llhmi " ln " 
° Sample Tut orials Prop osal 
Submissions 
° Interactive Video Pnstars 
o Worksho ps 
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CHI2001 

anyone, anywhere. 



Introduction & Overview 

The annual CHI conference is the leading International forum 
for the exchange of Ideas and information about 
hum ^-" m P"ter interaction ( HC| )- Diverse members of the 
global HCI community meet at the CHI conference to share the 
excitement of discovery and invention, to make and strengthen 
professional relationships and friendships, and to tackle 
real-world problems. Come to CHI 2001, and be part of laying 
the foundations of our discipline and identifying the challenoes 
yet to be solved. *" 

Topics 

CHI 2001 invites submissions on the full range of HCI related 
topics, including but not limited to: 

o Universal access and usability 

o Portable, wearable, and wireless computing 

o Internalization and implications of culture on design 

o User profiling and Individual differences between users 

o Visions of HCI In the future 

o New, integrative, or forward-looking perspectives on HCI 

o Analysis, design, and evaluation methods 

o HCI and its societal implications 

o Theoretical foundations of HCI 

o Devices and display systems, tools, and interaction 

techniques 
o Critical reviews of HCI work 
o Education about HCI 
o Case studies and design briefings 
o Guidelines and design heuristics 

Participation Categories 

The field of HCI includes many interests and perspectives on 
human-computer interaction. In order to serve this large, 
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CHI 2001 has extended a special invitation for submissions 
related to the conference theme: anyone anywhere. See CHI" 
2001 C onference Special Areas for mnrp Information. 

CHI 2001 has especially, encouraged the submissions of 
groundbreaking basic research across the technical program 
Recognizing the continuing need for establishing a research 
basis for Investigations focused on enabling all users access 
to Information technologies, CHI 2001 Is committed to the ' 
Inclusion of high quality, empirical investigations aimed at layinn 
the groundwork for further research and development 

JJ 16 ^' 2001 Development Consortium u/ill fnrns nn r. a ij,i nJ 
I CHI 2001 9°al of providing unique opportunities for bringlnq 

together diverse members of the global HCI community, This 
! will be accomplished, In part, by the inclusion of Latin American 

researchers, designers, developers, and educators In the 

exchange of ideas, information, and accomplishments at CHI 

2001 In Seattle. 

CHI 2001 Is revamping video submissions this year by 
eliminating video papers from the technical papers forum and 
video demos from the demos forum and Introducing Interactive 
Video Posters, This new venue will enable highly Interactive 
exchanges of ideas and breakthroughs In the community. 

Acknowledging the plethora of employment opportunities within 
the CHI community and the need within our community to 
enhance communication between employers and potential 
employees, CHI 2001 will be providing special opportunities 
including recruitino bnnrhs and the ability to reserve space for 
job announcements, In order to Increase discussion and 
networking opportunities at the conference. 
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Conference Committee 



below or use the online feedback fnrm eSS " sted 



Management 

^i= fe , re ? Ce 2 Teehnlc <d Program Co-Cha)rs 

Julie Jacko. Georgia Institute of Technology 
Andrew Sears, UM8C " 

chl2nni - r hi ir " a firm l ffrn 

SIGCHI CMC Liaison 

Kevin Schofield, Microsoft Corporation 

ACM SIGCHI Program Director 

Alisa Rivkin, ACM 

Conference Manager 

Paul Henning, Conference & Logistics Consultants, Inc. 



General 
Information: 



Technical Program 

Demonstrations Co-Chairs 

Nancy Frlshberg, New Media Centers 
David Hamilton, Connex, Inc 
l^lam^gmasigacjLPig 

Design Expo Co-Chairs 

Johnathan Arnowitz, Informaat 
Elizabeth Dvkstra-Erickson. Generic Media. Inc. 
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The CHI 2001 Call for Participation describes opportunities to 
partapate ,n the conference, Including twelve pESdon 

cSe r ce. SPOnSOrShiR eXh ' bitin9 "* volunteeri "a afthe 

^ H L Pr y g r m Fnr ™ Ascribes the 
Hf fortne Conienze Publications Format, Electronic 
Submission requirements, and Poster Preparation guidelines 
There is an online process for submitting Cover Panes and a 
guide to successful submissions. PleasI also note Te 
guidelines on video submissions. 

The fegisjiamaisjms are there to help answer your questions 
about the submission process, and the conference in general 

YAttadescribes the many ways in which you can help 
«ihmi«tal' Udes mentorin 9 someone through the 

subm sslon process, as well as submission reviewer 
volunteering and student volunteers. 

I h * e h?,= l . Ment ? rln9 . pr09ram P alrs people with experienced CHI 
h^.M Tf ^ me CHI P^lication process^ MSQhJdoa 
sh^S e , f 1 r lirst ; time authors submitti "9 tutorial s "paperc, 
short talks, interactive video posters, and student posters 

^STni" "nnnrT t tniT iPT are available which will demonstrate 
your orgarazation-s interest in and commitment to the field of 

Palpation Caff n orie ^ The field of HCI includes many 
ordefnf,^ . P S?1 eetive u S on hun ™-computer interaction. In 
S3fp n., • ^ 9 - e ' heter °8eneous community, CHI 2001 
EaS™^* sub ( m,ssions h '2 participaaon categories, 
ale unS.^h"^ " l^ 0 ' '"'^active Video Posters. If you 
are unsure which category to submit to. please consult the 
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Reviewer Volunteer Center 



CHI 2001 Partfdpattai Categories 
Volunteering to review for CHI 2001 It 
open: 

• Tutorial* deadline was 3 June 

• Paper* deadline was 18 July 

• Short Talks and Interactive 
Posters, Student Posters: 
deadline Is 1 October 

Mrout Vour ProfQa 

In order to volunteer as a reviewer you 
will need to provide: 

Contact Information (address, telephone 
number, etc.) 

Reviewing Interests (ranking of topics 
you are willing to review) 

Reviewing Background (your revlewlnq 
history) 3 



CHI Reviewer Volunteer Center 

SSS*!*™* G ° t ° f ,a P^^V^ In ninf 0 rCHlP o nimM lrrr,-n ff ,o see what papers you have been 

CHI ZOO. Is now accepting, volunteers. CJdUffllwIil be March 3, - April s, 200., Seattle. Washington, USA. 

• LfiaJa If you are already a member of the Reviewer Volunteer Center 

• Sjgriutt If you have not reviewed for the CHI Conference TateK/ 

• q« a reminder. If you have forgotten how to login * 

I TS,™,™^ ? we " tnou 3 nt °. ut registering to review was actually a pleasure!" 



Paper Submission 
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Papers 

Deadline: B September 2000 

Pape L S p J ese ? si Bn«icant intellectual and technical 
contributions by researchers and practitioners to basic 
research, development, and practice in all areas of the field of 
human-cornputer Interaction. Papers are presented at the CHI 
conference and are collected In an archival conference 
?»«pff^ n9S ' Wh 'l- ' S P ublisne « ^ ACM and cited and read by 
\l * , V s -' P™ cWloner s. and educators worldwide. A paper 

H^n nSl rr "2 hBVe Wide im P aCt 0n toe Study Of 

HCI principles, theories, and techniques, and on their 
application to Interactive systems practice. A Guide to 
Successful Paper? Subrnl^lnns , Is available. MerttofL for 
papers Is also available for first-time authors. The deadline to 
request a Mentor Is 9 June ZOOO. 

Submission and Review Criteria 

subm j ssion £ ^ reviewed rigorously by a large pool of 

HaZZrlT fr °H m * e ' ntemaUonal te=nnicaJ communl^ -of 
HCI researchers and practitioners. The content and 
presentation of submitted papers must be acceptable as 

Zt.J** revlew p [ ocess attem P ts 10 ens ^ that papers 
are assessed ngorously and without bias by applying the same 
comprehensive set of criteria to every pspe?. AccordlnoN' aT 
papers should be prepared with corv^e^ rfteertSte 

„ • "I? contrib "*>n should be made clear In the abstract as 
c^ ° fHCI - ^ COntributions P resa " ted b « 

° n«ds B of e°nd^ raCtlVe ^ *« SUPP ° rtS *• 
o an Interaction technique, device, or other component of 
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Deadlines 

Submissions Deadlines: 

Qsmsasmssam. 

Desicn Fxpn 
Develonm sntCnnsnc Hurn 
Doctoral Consortium 
Interacriup Virion 2S SSSIS 
Panel? 

Vision Statement 
Final Submission: 
Eaaers 

Short Talk s anrl ln( pr«r-ti.i» 
Special Inte rest r?rni l r)1 
Student Pns tpr* 
Tutorials 
Workshops 



Deadlines 



8 Sep 2000 
8 Sep 2000 
8 Sep 2000 
8 Sep 2000 
8 Sep 2000 
8 Sep 2000 
8 Sep 2000 
14 Jul 2000 
8 Sep 2000 
8 Sep 2000 
Posters 8 Dec 2000 
8 Dec 2000 
8 Dec 2000 
28 Jul 2000 
8 Sep 2000 



Volunteering Deadlines: 

Student Volunteers 
Preliminary deadline: 
Final deadline: 



8 Sep 2000 
26 Jan 2001 



Requests for Mentoring Deadlines: 

Papers - 9 Jun 2D0O 

Shprt Talks/lntBranliup pnst P ^ 29 Sep zm 
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Registration 
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Advance Program 
Technical Program 



Technical Program Overview 

Demonstrations 

inSf aH0nS ?uJ" °PP ortuni ty to show an innovative 
^rrplHpp=° nCe % HCI s ? ystem ' tec "nique, or methodology 
Attendees are able to view systems in action and discusl them 
with the people who created them. 

New! Design Expo 

A new event for CHI 2001, the Design Expo Is a unique 

for ^signers to present new ideas and innovations 
to the CHI community. Designs will be presented In a nnovauons 

Vestas f ° rmat ' Auth0rs wi " be available for 

New! Interactive Video Posters 

This new venue will enable highly interactive exchanges of 

ideas and breakthroughs in the community because it 

wC^p^ 
Panels 

Panels stimulate thought and discussion about ideas and 
Issues of Interest to the human-computer interaction 
community. Panels typically focus on controversial or emerolno 

Papers 

Papers present significant contributions by researchers and 
practitioners to the HCI field, capable of influencing rSSdStan 
fifecycle of current and future interactive systems. Papers Jr e 
hlghV refereed and are published In the archival CHI 
Conference Proceedings and as an issue of CHI Letters. 

Plenary Sessions 

Plenary sessions are general sessions that open and close the 



224 



225 



CHI 2001 Site I Advance Program 




CHI2001 

anyone, anywhere. 



iiiTnoDucnoa 

s OVERVIEW 



CALl F0H 

pwmciPAnoa 



Introriiis tinn 
- Technical 

Conterenrp 

Information 

Accommodating 

Cnnfere.nnp 

Rsoistralinn 

Additional 
Activities, 



Shortcuts: 

Registration 
Conferennp 



° Human Pprfnrrppn,-., p nlpt , 

° Motion anri Emotion 

0 BfiSigning Wi th and Fnr nth.,., 

o Headv I gjjjj 

° Visions nf Wnrl, 

° Speech Sn^w 

° Sensable Nawirptjnr, g „ nrrh 

° On the Rnarf 

° Focus anrl Pnntov^ 

° Seeing anrl R einn S PP n 

° Home anri tfrn p an? , 

° The Writp St uff 

° gflJnmuniaes an rj Collahnratin n 

0 Social Interfax 

° 3D Navin atinp 

° Scenes frn tri the n ffire 

O Storytelling 

° InfcrmahVir) Sr-pnt 

° Public Disnlay ; 



Human Performance Points 

Date: Tuesday, 3 April 
Time: 11:30-13:00 

Scale Effects In Steering Law Tasks: Do Device Size and 



Paper Details 



The Write "Stuff 

Date: Wednesday, 1 April 
Time: 16:30-18:00- 
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An'Sc'ST Keyb ° ard ^ TraCk ' ng " *" 

Jlngtao Wang, IBM China Besearch Ub 

H^umMrt™ flJ f* den tenter 
Hui Su, IBM China Research Lab 

Model for Unlstroke Writing Time 

Poika Isokoski, University of Tampers 

Text Input for Mobile Devices: Comparing Model 
Prediction to Actual Performance 9 

Christina James, KellyRelschel. Teglc Communications 

Communities and Collaboration 

Date: Thursday, S April 
Time: 9:00-10:30 

Better Home Shopping or New Democracy? Evaluatina 
Community Network Outcomes evaluating 

John M. Caroll, Mary Beth Rosson, Virginia Tech 

Idenaty Construction Environments: Supporting a Virtual 
Therapeutic Community of Pediatric Pa«7nu Urfdergotg 

Marina U Bers, MIT Media Ub 

Joseph Gonzalez-Heydrlch, Boston Children ■? Hn™:,*i 

David Ray DeMaso, Boston a^ens rZ^/ ^' 

SS. 0 d e cXX Co,laborat,veAcav, ^ forthe ^"' 

fc^" eSh - K ° ri lnkpen - F * La ". Keith Shu, Simon Fraser 
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Conference Hotels 

I Sheraton Seattle Hotel & Towers 
Conference Headquarters Hotels 

www.shKratnn.rnm 

I The Sheraton Seattle Hotel and Towers Is located In the cltv's 
vibrant core and next door to the Washington State Convention 

renovaion ^ 6CentV COmpleted ' « -"Hon dSS 

renovation of the lobby, restaurants, guest rooms and suites 

S Leve? " n n e A Urban Style with t0 " ches Sage. 
^SSlS*Zr CWB ' a r00mS 0ffer ""Peeled amenities, ml 
the health club offers a spectacular view from the 35th floor. 

US$159 Slngle/$179 Double 
(Additional person $20.00} 
Corporate Club Level 
US$189 Slngle/$214 Double 
(Additional person $25.00) 



Mayflower Park 

www.mavnnu /emany^ orn 

This elegant European style hotel Is centrally located downtown 
cSnvenlence 9 " 7 PerS ° nal ' or yu r comfort and 

US$135 Sing!e/$150 Double 
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Paramount Hotel 

WWW,WeStCO«SthDtels.rnrn/ nflrfT11mt 
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Travel Information 

I ?™rf!ri f b o e n n e !? at the Washington State Convention and 
88101 USA Convention Place ' Seattle, Washington 

I For details on how to reach the Washington State Convention 
E. ili,n Center by car. please see www.wsctc.rnm Follow 
the link to General Information/Directions. 

Airline Discounts 

Special tilscpunt alrfflrfi-r on Northwest Airlines and United 
Airlines have been arranged. 

Rental Car Discounts 

Avis and AJanjo rental car companies will offer CHI 2001 
attendees 10% discount off the applicable rental rates when 
reservations are made In conjunction with United Airline air 
reservations. Please ask the reservaticnist for more information 
on car rentals when booking your airline ticket. 

Public Transport 

The use of public transportation rather than cars is strongly 
recommended. Cars can be hired at the airport, but their use 
within the city Is strongly discouraged. All hotels are within 
walking distance to the Convention Center. Most all of 
downtown Seattle Is within reasonable walking distance. Taxis 
are plentiful and fares within the city are reasonable. 

Parking Facilities 

The Washington State Convention and Trade Center has an 
underground car parking garage for those persons driving to 
the conference for less than US$20 per day. The hotels have 
parking facilities for hotel guests. 

Airport Taxlcabs 

Taxicabs are available outside the airport terminal. Typical 
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Keynote Speaker " 

* Bill Gates 

Chairman. Microsoft Corpora Hon 



CHI2001 
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St-:i(llr. Washington l.SA * 31 March- 5 April 

On-Line Registration System 

NOTE: Early registration rates are in effect through 1 S 
February 2001. Rates are higher on 1 6 February and thereafter 
- so register nowl 

This on-line registration system is based on your use of a 
credit card to pay for your conference registration. 

If you must pay by check please download th« nrrfpr f Pfr n 
which Is stored In Adobe Acrobat format You can also 
download the Adobe Arrnhnf Rppripr K r „ don t have it jf, en 
rill out and mail your application form with payment to: 

CHI 2001 Registration 
c/o Registration Systems Lab 
2060 Goldwater Court 
Maidand, FL 32751 USA 

Original Registration 

IMPORTANT NOTE: Your registration Is NOT COMPLETE 
until you receive a page titled 
"CHI 2001 - Your Registration Acknowledgement" 
This page will contain your live or six-digit Registration 
Number. 

Jlvgvj fillnittthft fnrrw and gHh mltwQMr QrHar goH npthl nn 



231 



Tutorial Registration 



Registration for Tutorials 



^^1^1^^ real tutorials, Just examples. 



An Available Tutorial 



A Sold-Out Tutorial 



7S 
sold 
out 



- Tutorial Number 

- Check here to select this tutorial 
• Number of seats left 



<— Tutorial Number 

<— Sold out: 

«— No space available. 



Important: You may register for up to six tutorial units only. The on-line 



system will not let you register for tutorials or workshops 
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Location 

I Seattle, Washington 

nil!- n°r * W d ^ ke K P , laC u e in Seattle ' Washington, the "Emerald 
City of the Pacific Northwest Seattle Is nestled on a narrow 
i f^P °. f land between Puget Sound and beautiful Lake 

snfrn ?h 9 I° n ' \° est are the J' a 39 ed Olympic mountains 
and to the east are the volcanic peaks of the Cascade Ranqe 
with snowcapped Mount Rainier. Seattle has always offered 
lh2°M a ^ nS '? m ^! ic ' film ' theater < ™ d f00d and * is the jewel of 
explored ""^ eXCit ' n9 ^ lnteresting sltes t0 be 

CHI I 2001 will be held in the Washington State Convention and 
l rade Center, an award winning building designed to 
dramatically integrate the vitality of this international port city 
with the natural beauty of the Evergreen State. The Center Is 
located at 800 Convention Place in the heart of the downtown 
area. The main conference hotel is the Seattle Sheraton located 
nearby at 1 400 6th Avenue. 'ukkbu 

The Washington State Convention and Trade Center is twenty 
minutes from Seattle-Tacoma International Airport and just 
steps away from some of the city's finest hotels and 
restaurants. 

Travel information Is available, as well as descriptions of a 
variety of Seattle attractinns 
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CHI200I Seattle Attractions 

anyone, anywhere. 

Ballard Locks 

pie Ballard Locks connect Puget Sound with the fresh water of 
Salmon Bay, Lake Washington, and Lake Union where you can 
watch vessels being raised and lowered. The locks also 
feature seven acres of botanical gardens and salmon fish 
ladders that can be seen from an underwater viewing window. 

The Burke Museum 

Enjoy spectacular artifacts and amazing specimens at the 
region's only and major natural history museum. The Burke 
Museum houses many Interactive events and exhibits such as 
a rumbling volcano, real dinosaur skeletons, and an Ice Aoe 
mastodon. 

The Experience Music Project 
The Experience Music Project (EMP) Is a one-of-a-kind 
music museum combining interactive and interpretive exhibits 
to tell the story of the creative, innovative, and rebellious 
expression that defines American popular music. This newly 
opened museum features a world-class collection of artifacts 
unique architecture, state-of-the-art technology, exciting 
hteractlve presentations, and a dynamic ride-like attraction. 
EMP will encourage visitors of all ages and backgrounds to 
experience the power and joy of music In Its many forms. 

The Museum of Flight 

The Museum of Flight showcases the history of aviation 
technology from its Inception to the present Exhibits are 
housed in the Red Barn, Boeing's first manufacturing plant and 
in the glassed-in Great Gallery Complex located near Boeing 
field. 3 

Pacific Science Center 

Located under the arches near the Space Needle, the Pacific 
Science Center is a six-building complex offering hands-on 
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i The following materials are available to those who will be 
presenting at CHI2001. 

All materials are in PDF format and require Adobe Acrn hai 
Reader. 

! Author Kit for Demonstration Presenters 

1 Overview 

How to Produce a Ca mera Ready Document 
How to Prepare for Pres enting at the Conference 
ACM/SIGCHI Technology Support SaegfcSl R equest Form 
ACM Permission and Rpleasp Frjrm 

Author Kit for Design Expo Presenters 

Overview 

ACM Permission and Release Fnrm 

How to Produce a Came ra Ready nnri i m ent 

How to Prepare for Pre senting at rhe Conference 

Permission and Release Form for vin>n/A udlo Suhmlssion * 

Author Kit for Development Consortium Presenters 

Overview 

ACM Per mission and Release Fnrm 

How to Produce a Camer a Ready f)nn [n^ny 

ACM/SIG CHI Technology Sunpnrt Summary 

Author Kit for Doctoral Consortium Presenters 

Overview 

ACM Permission and R elease Fqrrn 

HOW to Produce a Camera Ready Dnci mr^ 

ACM/SIGCHI Technnlnn v Sucnnrt Summary 

Author Kit for Interactive Video Poster Presenters 

Overview 

ACM Permission and Release Fnrm. 
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Resources I Annotated Bibliog raphy 

Resources 
jAnnotated^ibliogr^ 



• The annotated bibliography for this tutorial is available to tutorial 
participants at the following URL: vd.iaoie to tutorial 

• http://dfki.de/~jameson/chi01-ttrl/ 

• The use of an electronic hypertext format permits 

•. Inclusion of a large number of works 

• Rich indexing according to the concepts used in this tutorial 



mousfclick 16 ^ 0 " 10 Versions of works ava 'lable on the web 



• The bibliography is platform-independent 

• It can be used directly on the web or downloaded to 
computer 



via a 



d your own 



Readings 
Readings < 1 ) 

The three readings reproduced here have been selected because 

• Together, they give an idea of the nature of original literature 
the area of user-adaptive systems '«««Hure 

• They are exceptionally well written 



Reading 1: De Bra et al. (1999) 

De Bra, P., Brusilovsky, P., & Houben, G. (1999). Adaptive 
hypermedia: From systems to framework. ACM Computing Surveys, 

© Copyright 2000 ACM. Reproduced with permission. 



Reading 2: Maglio et al. (2000) 

SUITOR P An 'if?"' R V Campbe "' C - S - & Se 'ker, T. (2000) 
Tin on™ ^ attent,ve '"formation system. In H. Lieberman fEd ) 

http://lieber.www.media.mit.edu/people/lieber/IUI/ 
© Copyright 2000 ACM. Reproduced with permission. 

Reading 3: Segal and Kephart (1999) 

© Copyright 2000 ACM. Reproduced with permission. 

Note. MailCat was later renamed "SwiftFile"; it is the same svst™ 

that has been discussed at some length in this tutorial V - 



